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(a) mTlE'>#< it— o©/<^— >W<*fc»4M#/< 
^y^k. 

(b) *tfl$nfcMIE'>*< fct-oo/<#-yi«* 

fctti®^^— vu:#&-t-5gE?¥fe£«!ij£-f-3 *-r 

k, 

( c ) i!&5E'>fc< k h — o<o/<*~ >mi£-£.fzi±m&'< 

( d ) jffl^ Ufc*WBR#fe«rtinE'>* < i t— oWfilft 

J£cd& SrttiE-f 5 * * v k % 

[If 2 ] 1MB** < i <>-■ o©«ftfe<Dtt (IBtt 
fe) *±tftfflER#fei:<BlW©iB£«:WJeU tufEffiH 

<5^T, WIEBlfefeWffi (Eftfe) MJgLfc 
«HSgE#feK:« 9 a "C S i i SrWR i i"« 1 tlB 

[ff#«6] 8E#©fe*4\ »lS-t-4itrE*Hlfe©ffl[ 

[St#3£7] 11*«©fe©it«:§E#fe©flti: UTttJB 
UT, KHJigUSWE^* — >^*OR#feSr*|jEi-5r. 

[f*#Jg8] fB®^t*^«>S*^^ — v£r^tf>g^ 

m 8 miEe©**. 



fejsiV/sfcii^ffl^riBttJSfeiofeo^*, 3r*ri-« 

S&fB^^-vSl^feWbtbfcfe^Srfflv^wi:^ 
£-f-3B&fe©ffi (lEKife) fc-Srt-atWW*^*^ 

jftSr-oawi-ra r k z&wkirzmxms ciajo* 
[s**g 1 2 ] feWjEtfflv^iiJPOf*-^ k vxm 

[ff#Jl 13] ( a ) 0f^©fe^ra^*3»t Sfeffi (IS 

life) a&im *'pt£<ti> -ott^i- s^fyyt 

(b) HtJiS^lf©^ 1 *^— o©$NJ£iiufE'>ft< 1 t> 

(c) ms/pt£< kh-mm&'^-^o&m*. #j 

[ft*JS l 4 ] S&lcfeffiiESrtTofcT^ v?^/w^K 
[ft*«15] Bt)IEgE#fe{cM^-r?>emfecoffiS:ft 

HufEPHt^- ^ ©fefifi© Jl x £ *7VWti- 5 fe© ^, XL ^ 
tf J: 5 fctME* JMHS SrStS&f 5:t Sr#?S k 

-tzmxm 6 t-ia«©^fe 

(a) 

(b) m&f-9®MUk, 

(c) Btfef*— ^SrfE®-f-5fcie><DiH4fe^— ^IS^klfB 
k. 

[0 00 1] 

^ ^ - M *■ ^ tr ^ X H «l © fe « IE -T 5 * §i f 
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[0 0 0 2] 

^KBtett* O*^**^ lb 

o :7*iE®B{&tif$Bfi* T-i-viT ■ fj'JjrA' (A/D) 

(fciM, T'ii^tEPM*. *fcl±, B 
[0 0 0 3] ^HBIkSrlEfrt-Si: S^TS* 

U 3-— !f^*^«]lw*^$ 
5£i^5F.9)S;0 J *>ofc. #3693 fit- ©J: 5 &£.<E>T*Uc: 
[0 0 0 4] cwi^ftlSSS^-fixwBHUittKWtt 

CCDf y^fctt7^W©^^ h^^s 

*s*>S. *^7-C«f^i-5¥K©M««5©fe«:, IBM© 
[000 5] iiS©A^(±x **©*45l»Bi*#Tfc: 

COMfcl : 'Measurement ofColor Constancy by Color 
Memory Matching*, Optical Review, Vol. 5, No. 1(19 
98), p. 59~63 x http: //annex, jsap. or. jp/OSJ 

/opticalreview/T0C-Lists/vol05/5a059tx. htm#^) 0 
A mz&ft& h -5 (O h feotlfttt 1 1> 5 *Pj?:*£ittf s *> 3 
b -C 5 . It I43t « i: * 5 AH W © rt * t ttffi »«J K: 
MH^Tfc-So ft, 9*fc.fco-ClEak$nfc6M 
HMW3t {^^ if 7^7-1^%. 7 7 -y^^-ftM. B3t/<C 
£:*) (D7s<9 h/KTW-tSff-f-^o 
[0 0 0 6] Sfcfc. AISIfiB«4SJr*i^Tilllfe*.!6S 
*>5fe, AM, Mm. 1»IHJ6S;fc.tt:^ 

L — (fcix.tf> ilKWfe) /£t*^IE1SLT^-5o CM 
YK (>>7^ -^-tfv** H, fciotn) fe^fc**^ 
T, efeA*«?M©fePttl3C-40M-45Y-0K-e*>5. :tl 



4 

fefi. 'Pte< i tefeAaco^v^ttfcit/^crjMco 
file— ««jK:a-Ctt*5flfC*9, ii^x 

l/5~l/3T*fc5. -r-t? ^fiom&nX 9 t>#V^§^fi, 

M»fed s S''^-a {C<7?^-g-*tu5 (http:www. colorbala 
nce.com/html/memory.html) 0 
[0007] Z.(OXb ^IEltfe^*eEi-5^KB«T 
io ¥XB«fe©#^ft)feSrft*i-5IStSfeSr, fettiEco 

[0 0 0 8] LA>U *|-**s^(7)J: b^7 4 'sf^mfo 
ffcott, -^(OB^wfe^-^^TSrttlE-r-STt* 

5o 

[0 0 0 9] Wfc'** — ^iWftlflS^O^HEr-eHt, IE 

JgfcHfi, fc£;iti, Bte-^-*l-te5E*fcte&:HSran*. 

t£Z>&*m~$-z> -zimmmi* >7?r^ ^ ^ 

[0 0 10] *:<Dib\z1>miE#&9ti:t£&&n<DeM* 
30 [0011] 

JwAFflWWWB^^-^^ff^i-SA^ 5 d»SrflS®-t- 

40 & »£ liigffl V # /£ v > t v ^ o fc P^)B# o fco 

[0 0 12] #3gWf*. ^S^B^- 5 ^ — ^co|2ti^,Sr 
IBftWift©^— ^*|jE©#BRfei: LTfflV^^feffiiE^ 
ftSrttiitrr?) r t SrSWttS, AM© 

!EitfeKg^-cB&<o&£*ii:E-t-* r t * e t -r 

[0 0 13] 

so |^t5tfflt*$>5„ 
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[0 0 1 4] &&W<DB&)l-i. J f-m^mt£ffl&HO& (E 

'pt£< £k-o©6£MjE^5;fr&K.fc9ii/££*tSt> 

&< tt> — o<ds<#— >-ffl$,$.tz.itffii&'<'5 r — v<r>-& 
ffi, *s.fcU\ fct^tf, 'M<it)J6WWi!fe 
Sr^tB-t-5c ifS^-^ffi^fcteilMk^-v©^ 

So 

[0 0 15] Cl©B&&©titf^ V^^SfEttfel-tBS 

S. PH&^-^Tttey^ — >"fW£©feW^&£> A 
#S« *^BJ<D*iS(cJ;n^ #l:A^©Mi'©/^ 

fcSo 

[0 0 16] ^©fE^PHt*^ fcir^fi, 0s it 
•£fcf^©^£fti©S&S«ffl©®&'<*->'£ 
^^S^t&tt'bifcS*:*, Z.tib<om&'*?-><r>Z: 
H-efrf-o^T^SK £t>— o©S&&, -rftfr^AW 
(DlEtS-fe. fcg^L.T^i&gdSfcSo -?:©fc*, 

-^<OBi^^->-»w^tUTAra^iEtft{^otE«feT*a 
^ifcjlSr.ir^lteiftSo 

[0 0 1 7] oco#3S^3liS0ii»-J:ti.tf, '> 

& m £ htc/< # - >"Hitgc3; 7t fiH^ * - v©gE#©£ 
*->-©£fi, B&6£*:fiiEt§fel6©*-K«fcoTB 

[0 0 18] ±IE©'>/«£< 1 1— o©*fcifJ$;h. 

- ^ffi^c^fcf*®^^^ - ^©fe{jt©¥*SHtt£# 
^(D&<D&X<D&MsEtim\Zte\,^X^-<D¥-%)\&*&. 

[0 0 19] t>*>5A/, — ^a^cSfcliiii^^ — 



(4) 

mi£ Ltc&fr&^Mfc-r sem£©m i oats. 

[0 0 2 0] SfcKl, ±f5gE#fe£#]>?l3Tfc*tf;:B& 

©jsiiiife ©£fis sr *tiE-r s /c «> td »4^*aa^^ t tt 

SJt^tfcSo J: 0, *>5fef-B8b-C 

io &So 

[0021] &&W(D%\<Dmmm\±. aw©*» 

*it5t)©ffe5. rixb©®^^ — ^(i. AW* 5 
tE1S1--5> &S#ie©feSr£tfo rwUl&^JtcJ: 

if©, Jfct5EW^S^ffl$*i/5Pi«^^ — v»cf±, M© 
fe^ir©!Bttfe^*tv5 0 fcS^^©®^^-^© 
Bttfe ± O 5 ^ iH £ ixfcPHfe^ - v © fe 5 ^©fe©^ 

t> Bj^©^:T©fe^ttjE-t-SwtT?*mT-tS„ 
[00 2 2] \i^-rtUO&#<Offi&L'<* — V 

ix.tf> Henry Rowley©ffe5: r=a-h7/^5' 
^tc: J;SM^(±lJ ('NeutralNetwork-Based Face Detec 
so tion", PhD Thesis CMU-CS-99-117, Carnegie Mellon U 
niversity, Pittsburgh 1999) {C|e^$tv5 =•=-— h 9 
/^•^y-^fft, ^/cfiSchneidermanb©!^^ 

&J (*A Statistical Method for 3D Object Detectio 
n Applied to Faces and Cars', Proc. CVPR 2000, Vo 
1. I, p. 746—752, Hilton Head Island2000) (C|5% 

[0023] rr-cag/i©H. 0e>ttttid*3££K:glb 
©^©^iat-<toT^^st>©-efcs, #$gBj©3iife 

^JtC (iRowley*3 i U^Schneiderman h I- <t 5 ±IE5liSfciCiE 
« $ ^S rtS Sr»*iitf h © "T S» 

[0024] refc^£©«**m«©*ffl«AttEtefc:*j' 

LT^t?Ji^^fc*. ®^Sit)#S^:T©[Hlfe*(6]^ 
o ^ T ^ ttS *s«IHctT 7- S i 5 1- S j^S * s fo S „ 

ttffli"*ttttJ«»-J:oT»Jie5. ItkZ-l*. Rowley©^ 
so &-Cfl x ^±1 5° , Schneiderman©#?fe-C-(i, i^J±4 
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[0 0 2 51 fcirXfi, SchneidermanCOStfctbSSrffl^ 

±IE«&ffi^cD^ttiii&£^;h,eJx0 o „ 9 0 

° , i8o" . sa.tr/2 7o 0 nnE*«-csjei-5#ai 

[0 0 2 6] M.feSr&&i-5*5B* s 
Schneiderman&ttt8&©$&£\ 

±4 5° 

[0027] a. SfcttiiKfcifwpMft^*— >-»&e 

ostitis r*. i*ffl:jsj:i^ii*»$;fts*e>«$>3isifc'< 

[0 0 2 8] of (9 , #*9iU:J:5#ifcfi» ffi&LfciS 
lit, -tfttohf* i?9A&9L±.<0±Bs*9--*sV6ti 

[00 2 9] oft, ±gE^*-V«B«*fcttiIHfc>** 

©fe**sftj££it, ±B/-«^-^«*©fe»-fl5ST6 

[0 0 3 0] ifE^a^S^"^^^^-^ ft* 



(5) 

JlllS^W^xs/^ (b) ~ (d) Sri^ft !5 31 LSItf Lt 
t>i^. It^JSi <D*y-y? (b) Kttt^T 

fcfeffi$r«#«lx. ; 5o ^Wi^^iSbfi, a&BU*5<fcTJM£ffl 

tt^ fc »±@i^ — > *» e> t& ta $ t ft t — sr*- 5 
[0031] t*j5A/, H»f)eco^rtt»*bt^*, 

m*m i t «t 5*»^^T-r s r. t &v >^-t 

jart <5»J©&tt$M&fc Srilft U ;i<DBiJ t> 
[003 2] fci: BJSUisitmtasfeSLfc^^- 

[0 0 3 3] |+^iLfcrtu^co<SM^b¥*®^^, -f 

30 ft fc— Srt- 5 "5Tte'tt<OiS v n^^coISH K h Z> frif o 
fcds-e# 5o Z.<D&ftM\±. AP^/5 5 ferc»IEtil-S<5tNT 
[0 0 3 4] Sot, #3893l-.fc*UJ, &t£Z<Ot)Z>— 

[00 3 5] *%W<o;£j£U:t£oT, 7*4 i?^/u9XH 
^cofettjE^^tfU, laigfesrftigi-wm-rs-i:* 5 ^ 

co?a«^y ^ hv/^T 1 -^. ^t f5=^^j t twin 
[oo3 6] ±iE^y v^fTtfiJa^^y ^ f^ta 

*VTt>&»>^ M7 — ^ W^- ^-s/h, LAN 
&<!:*) *7tttE««tflc (CD-ROM, ^^^i?, * * 

so £.\,\ 
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[0 0 3 7] *$tmiz£Z&ffilE(D&mt LTffl^Sfe 

tt r#flgfej tfef-tthZc, zftb<D&m&&— «Wtwia 

tt&l-fB^U J3i:A/if©¥£BflM::*5^TBIfe©±SS 
ft»#©^Wftfe«:ft* , t'i , l>«>"e*>5. S£oT, r 
©«fc ?ft#$(Wft£. (fEttfe) fc£;Ltt, iffiffft 

sfcttamw^f-J^x, a«**ufc**o** 

Wife (EtSfe) ©*? f A'*r*#ttiL-T, r<o^7vwd> 
fc#$:iftftfe (lEItfe) #jlvir*^5£#;tk*v5£i£ 
##b*t5c ±fS£Jttt, #3£©£M©;fc&SrS-f£.tii: 

[0 0 3 8] *3S9I©*9i#tt, -oWffitSfe^-o© 
ftftfe) 4r*-f*#©fett*4>ft< £ fc— ^©#*£/8 

tt, 1#t-> fe^Wt-*5tj-5 2^5E^fcti3^7c©«5ia^ 
fc»i»#«r*i% "r^tofefe^Mk:* 
tt5#«, ©*fcH^3fctf-Cttft<» ±fE##}cJ; 

[0 0 3 9] fc£*.tf, ^<D/<7t— *tt, 

tt, .±flE^#ttfll^*Sr**"*"S. SiJ©5U£W£«fc*v 
tt, ±8E'"*7;* — *tt, ttjE&afc^lf^fettS**^* 
fc*iv<9;* — r©«3H£$:tt, fcSiEltfe 

©«S«tt±IBKtMMFttS* fctt-klB**** w<^ra i* 

[0 0 4 0] Sfc, Jt«^KHi-«f«IP«HlMta5*)* 

ffl v^IftW $ tvfc £ 1> 5 If «*s-7 f A ¥9 * 5 
Kf£fit$*v-0\h,tt\ yJv'y^W^^\^!&-t^ 

Sip©^*©ftfc9^ffll'»5r.£^pri6t?*) 
5c !!*©#*&£«, *>f>t*5»^# (B}t, 775/ 

art* if) tiJ?t5»rif&5„ 
[004 1] Ljb»U r©J:5*f*APWflf«tt£*TK:tt 
BJ-r5.fc5K, v r*Stf1t«J ©*^»c±j^Tffl 

tt, -o©|Elgfet-ML-C — :>©#*©*&»?> HITS 
:i#ft*U». *389§I-J:ntt\ fEt&£,tt#f$6i: L 

i-Bi-f-5fE^©7'-^tt^ j E-ya5»-s^$n, a^xi/ 



(6) 

mfc?-* S:*fcJE*r*--6 ^ £ t> WlgT-fcSc 
[0 0 4 2] #JS!lifc £5fe*IE#ft*fcttfe*liEge« 
tt, 9HiB«**i-H«r-^SrS«U-C*|jEi-5. B 
&^-*tt#£L<tt, fct^tt, IE«ttfls*fc»t*y 

tc, £fctt, *^wtc«t5fe*iEigStt, -r-r 

io [0043] |E^iIi^©fei[ttil^x v^/WfcStt, 
fct^Ltt, S«fc (fct^-tt, 0 ...255)©J&$H>fej&5 

©•rw ^^^mSrWSfcfelc, fctx.fi> RGB, s 
RGB, CMYK, Lab, C I E L a b ^©fe£Pnl£ 

[0044] #36Wfc: **Uf, #f$&*5 iU 5 /* fctt^ 

9S-Cbtv5„ $Jt)SXbix2)^ttgE#©^#»7!i^ 
[0 0 4 5] B&l-«9STb*xfc:9-;fti, i"**?*., B 

■r-^©sif^^jt*u, Bifc^^-vfciWEi-sfeffifc 

«<5t^T»3t £E#©#.«tt, ^*©fi^Sr* 

30 [0046] ^ufc^jaa^rffl^T, mi&f— *<o 

feffl, »4b<tt^T©B^v='-^©fe{tt^3EmbT* 

5c IEtSfett^*fe{it-C-tt*<, ^*tcJ;c»T*$ix 
■Sfcfc, *^PJ©feMlE©J^a»ctt r^rv'-^j ds# 
fjtvSc z.(D r7 7^-Sj t-i^^^omfe/i^itt 

[0 0 4 7] ^LT, JWT©^a-(-, -hKBLfc, ft#JB 
l©«fc© r-Scj ^ry^MJHfcrti^iSo 
40 rtbtt, #fiBgi5^©^m$nfcfefit^ % ±E«!?a-C6> 

feffi©/>ft< 1 1 1 ^^±|EfeSP^©JifBgi5^P^©«S 
Hrti-fc54i^-, *fctt, ^ISl^tvfcB^^^ — v©fe 
flS©tt t h if , * fctt^Td? ±|Efe^F^© JblB»»38M 
o«Hi*j^*>5»&-e*>«. r-ffe«j tt, *«MKr©6 
#ttJt-<7t, fiftu^fcttfifaws^^^i-^c mm 

so fT5-i:-e— ffeK©WffiSrtTx.5o r©^r&»-o^Ttt 
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[oo48] Ettfefcttfr * l < itmrn^ *i>mft £ 

»4, fc51#^^IE«6 (#RB£) ©*#Tfc*s»t«fett 

fc©M©— Jfc©KS\ ±faa^#*£ffl<< > Tf¥«-r5:: 
tt>T*#5o -©:©«©:: i:Sr r-gcgj tn?^rt*s 

JMWSjKb*K?-- fSc£(4ffi</.£5i:#*.T4v\, ^©«fe 

[004 9] o* 9 , J: 3*3Sfl:*yaWu Ktft 

&©f¥ffi£*r;£ U< f4/f!i^5 t><OT*fc5c -<P — 
(4, ±3z£©i*5«J, WftaM&fcJBv^TH-JM-*^ 

©ft* 9 It-frv^ tr*aMk*fflfcaait a— St* tUffl^ 
5rtiS-C#5, Siifc*&3l4, ::© r-ife^j 

[0 0 5 0] ~o«±, teXXfi/Sitc 

xvmfo^f—^hn v st ^tvfciEisfei: ©ra©*&"3- 

fr-eh,, — D©@Hfe/** — ^©fefiiLi:-?:©®^^ — V 

5c ±IE£-ft*tt, »*b<t4«m©<@S'J©-ifc«A> 
fejfcSBMfc-efcS. £5>Kl$r;£L<te, ±IEH^(4±IB 

[00 5 1] fllsp^SrJIffii-S**, 

[00 5 2] *7t, fl**$MIS*afli1-5*fi\ r -& 
&J W»*Ki*<J<*:«), r-ifeS|^j tu^ritT* 

-To 

[00 5 3] -§fe&*f4®&^*->-©£JSri s #$.£,S: 
3. ^tjtc. -SH**&BMfc^-* 
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v\, r©U#i:tt, ¥XWft&^bfcB#&T*3S£Lfc 
fc© (fc£;ll4\ 7 9s/->^3ti!S*i:*©, «f£*t*&© 
fcfc©^©*^ h/HciSt©) *^PJldJ: 
3feJfiE7JSfc3; fctefettjESgfifc 4 9 H&x-* #ft« 
$ix5*-e©(^^^L7>it©Sr-&tfc 2%#ctf)^#l-K 
•f-S^©4 5fctiNSU4, r#Wfl|*j 'fcfcBftfttS. 

[0 0 5 4] feME&»«*sJ:t*feffifcBBi-*flMS<o*. 
KJ£-3^t?t5 -i: t>"I«it?fc?)c feffiSrLab^ h/w 
£ LT^-f-^a-. aib©^ h/HtW^tciS-'^TffljE 
•Ht? ^tt-C^Sc r©45*g»)W*. 
ST, ±J4TJ?ME©3E**J^»4. feWg^^Kffft 

st#, &nb&mzR-rz>tiimfctt£ifLt£^-e'a 

[0 0 5 5] IICiPtT, £fc(4, awttfr!?}-, ^© 
X £ 1" 5 (4# m »4 ^ u - * 5 » 

[0056] miEbfciiHfc^-^asfcsma** (fct 

ASfft^^otlT, S^fe^#*# (International 
Color Consortium, http://www.color.org) $.55?© I C 
C7 p n77'fA'^ifO*5-V^^ V h7"D7r^^ 

[0 0 5 7] $e>t-, SfcttfttoUK. APflt-45Pi^ 
©fe%©m^* :, e>ttIESr : ffo-Cl,4V\ -©fci*^. Ma 
rk Fairchild©^Cifc Tfec>l,x. ; ev ? -'V^i:CIECAM97 
sj ('Color Apperance Modeling and CIECAM97s", Tut 
orial Notes (CIC99), 1999,Armin Kndig) t^foSCIECA 
M97s©4 5*fe©^^tx/V'SrffifflbTt4v\ fe©^, 

^mtoSSr, -©4 5*fe©M-^^aSr-g-tf4 5 lc 

stjg-rsc 

[0 0 5 8] #|g0J3f4;£ifc©^*?>i\ 7"P^7^ *5 

j; tf* ©^ d ^ 5 a srM x 3 v e a - ^ ttw.mmz & 
7^x®«;Magetcffi-rst,©Tfc5c ^©45* 

-r^ v 5 ;?/Hil^7 f -^S:S(S-t-5fcfe©A7^#Ss 

#fig^Srs^-f _ sft.«>©s*i# i ©x -^b#Baas^-© 
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[0059] te^nmiSL&mmm*. asic® 

t - ^ 0 x ^ d ^ 9 J* £ H 3 y t° - 9 % fc (4 y •? 
[0 0 6 0] 

[0061] n^oa^iait-ii. «Ttiis^»--^&-r5 

i^^J^X-hin^i^^hX^^. fcixfcf. Henry 
RowleyW^^C r=;x — by/^y hV> — ZXZ.&'&Wfc 
ttij ('Neutral Network-Based Face Detection*, PhD 
Thesis CMU-CS-99-1 17, Carnegie Mellon University, 20 
Pittsburgh 1999) lZsH&<D~=.— b 7 fr* y h? — ? 

^fcfiSchneidermanfjCOf^X f&. *J J: if <D 
3&5LWfc&ffiKfflV^^trl&^8:l ("A Statistical 
Method for 3D Object Detection Applied to Faces a 
nd Cars', Proc. CVPR 2000, Vol. I, p. 746~752, Hi 
lton Head Island2000) K%tM<Dv~ ^ — ^Uy b^fett 

[0062] rrt-iS^roii, m<o&M&?&-£\cBM 

0iJIC (iRowleyjo J; T/Schneiderman 5> JC <£ <5 ZSCSfclCfBiE $ 
[0 0 6 3] IStA/ifO0^W§lcD^mi6^»4(Hlte^M 

^ffl-r?)^ffl§§t-J;^"CS^5o fcir^tf, Rowley©^ 
feT*C±. #J± 1 5° > Schneiderman0^feT?W: N #)± 4 40 

[0064] fci Schneiderman<D®^till§5rffi<' N 
fc->^xA|cii4o(DiS:|5g^^S-C*)^c l-^^^S 
±IB®^imit©^-««^Sr*tu^ ? tb0 o , 9 0 

0 180 0 , is£xfi2 7o o ®m£-&xmfe-f-z>&^ 
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[0 0 6 5] mft&ith&tlfUi. MfeSr^^"t" ; 5®H^ 

rti5-e#5o Schneiderman&tHSgtf)^, 1^111 
±4 5° WrtirftSo 

[0 0 6 6] El 2, 3f±, &m : #Mie>W&<' < # — VCOSt 

[00 6 7] Hi^^-^SrSaSU-rSfcfe^, «<£>#& 
[00 6 8] o#*tc, «t •) . *9 

[0069] — wc<D*jmtiL&mbmi<^m.&t, mieo 

V(D«^^'6©lfeSr^fctlLT, Sfc(4, ^til^Jxfcili 
&/< 9 — ^cofeco sp^lffi Sr * T , HSV&SK * It. »±RGB 

[0 0 7 0] J:*)«$i*«iaSriiffl-r-5ri:f5rtl-efe 
tut 5o 

[00 7 1 ] **WO$&lcSijoflia5lwJ:S6*|jE*& 
[0 0 7 2] B1»fel±jEa^**tfcfefflmKJ:oT3e« 

■tjmxhZo 

[0 0 7 3]*^©A*f-^cLT < {t^hX.\-i. 

^^^M^fcit^lEISfeAi^fiJi? ^TbHrt. PH£ 
±©'M<tt>-o©ii^^-yi (i = 1 ... N)5r 
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[00 74] ®^/-«^— ^z:oJW±wf^-t/vd^^ 
\i'^±/^<o-&jiM.<^ c P^UxhoXh ii^ s > pHfe/<* — 

[0 0 7 5] pi^-h^^SrfiSLTiif^^— VSritBU 

[0 0 7 6] Xtsy*—*. irt£t>h. >\ m 

[0 0 7 7] 
[&U 









g' 


= T 


g 









[0 0 7 8] i£ (1) -ettfefiSrr, g, bt LTS UT 
rftfi— 0yt?fot). -tcomw^. fcir&fi, 
Lab^fe^Sril^U-CtxtV. 5£ (1) ©^Ttcj:*) 
r, g, bO«tt«rL^^"fe/HBr\ g\ b'K:^gl£;h, 

^&<D#|#G. WyszeckitJit/W. Stiles^ScD rfe£|. 
m : nitt^m. %&#)7 :t -'?*$£XMk&,] (Color Sc 
ience: "Concepts and Methods, Quantitative Data an 
d Formulae", Wiley, 1982) fclEttSHTV^S. fctx. 

a. UTvy&m&m&ftixh^^o 

[00 79] ±f5r. g, bm^MiLmzfem&MtZc 
[0 0 8 0] feffiSrfc5feSP^^f>SiJ(Dfe^r^i^ 
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■f-5. fctilf, r, g, HH$:XYZ*6©»::aaftLT!&» 

[008 1] J: <0 , r, g, bia^fctt-^-OffllWfe 

5o 

[0 0 8 2] ±56dfe^<DI/^-ftt^C*JV>T— 
93£©tti£ <P<k t f 5 E^Sr*i-=fT?iJ-efeo r *> J: 1/ \ 

[0083] E*fefc»*i-*fe«©^*n:HJti-sia 

tftfeo^e^ttst^^/p-efcS. #iEt£feAk (Ai = ^ 
MfeSfctt^v-, A 2 = W£* A 3 =A1, A4=^i¥) 

[0 0 8 4] p(a, b | A k ) • • • (2) 

20 [0 0 8 5] ^ (2) tt/<7^-*a. b"C«$ixfcfe|t 

r©/'!?^-^, b^Lab-<^ h/KDfiE^a. btwffia-f" 
5tiR3ti-5o (2) IBtSfe 
Ak^^#Tt?©feffl[a, b(D5l*Sr*i-o 

[ o o 8 6 ] ^ ( 2 ) fc 1 s mK<owwmmc 

*^«r2^5EW#^*^'?^Si»i-J:«5*-ri:»^ L 
30 ggj (^) , rxwij (£M0 » r«»i d^fiS 

^■Tc i-^^*j04cDSI^±^fc5^:TcDfefit(a, b) lz 
MVXpia, b| A!> =0.5t^ot^5 o 
[0 0 8 7] tAT-ed, lJ^^-V<D^m Ufcfefltt 

[00 8 8] ^#IT»2 3x3 ftm<OMftf&ftZ&1rm7£ 
40 gc<£>^7^-* (fctittf» ^rf, gf, bf) Ul«fc!9# 

i:, ^^tbfcf^ir/Wi, g'i, b'i*s, MJ^i-^IE 

ftotzW&'<fi— ViWA^feffiri>gi>bid^rttfeCO 

[0 0 8 9] Tftagj <o@S»±. Ubfe^ 

tiL*, a * % b* (ia4#fiS) ti^xm-r^thxt^o Z 

HbO^^-»iCIELab^fe^tClBiai-5t>cD-Cfe5o K. T 
so oepferfcitfR. CookinghamfC «t S-OS^W^X TfE 
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ltfejSfe<DSfittj ('The Quantitative Aspects ofCo * [ 0 0 9 0 ] fcS^&T 9 ( 9 |4tO««»i0^7^ 
lor Rendering for Memory Colors', in 1ST PICS2000 -*£«-T) £ffl<^T\ Wfc^-l'iOa, MUST** 

Conference, p. 94-98. 2000, MS)(Ct4, UbfeSM* U: J: 9fr»i"S - i^T?* S. 

ISiSfes tt^TWftfi, *fem-t5<D\zmVX^ZZh [00 9 1 ] 

a'i=f a (r'i, g'i, b'i) =f a CT 0 (r i( g i. b i) ) • • -(3) 

[0 0 9 2] 

b'i=f b (r'i, g'i. b'i) = f b (Tfl (ri, gi , bi) ) • • • (4) 



[0 0 9 3] 5£ (3) > (4) ICtt^T, f a . fb«^ 
-T5RGB (fc irK.fi* sRGB^fcttAdobe RGB) fi^KlCi* 
It 5a, bffl[«rff)|-f«*:ft«JB8««r*r. 
[0 0 9 4 ] a i, b' itlEttfe^TVK i"**>*>* 
(2) tci!5^a$^'5?t*^$rffi^T, 

[00 9 5] 
[§C2] 

p(D|e)=np( a 'i. b 'il m i) — (5) 

1=1 

[0 0 9 6] ^5**p(d I e)i-i±x<DM&/<*-^<n 
■(1, ja^OWfc/**— 

-t" 0 ^oT^5t^p(D I d)^^^^-^ e <D0ift 

[0 0 9 7] Bayes<D5£KJ:;ft,f£, *#f<t 

p(9 I D) « p(D | 9) • p(9) • • • (6) 

[0 0 9 8] *m?»*p(9 I D) II, Kh*f~-9M>*t!fr 

T\z.tstfz>&w< : 7*—9 e<Dmm*mi-, oso, f 
rrofcfe, P (9 Id) n±5g© r— ffeSFj <oR§Lkta 

i5f#5 0 *aHfctt* (6) Of«S:*J!)5ri-!?I 
l±43EP*TifeK: J: 9 3 - £ * s T-# 3 0 *3SE 

[00 9 9] pMfe7*-*©6«IE»::B8i-£_h3E*liffil# 

*>o"Ct>J:v\ r— ^6*Jj »t9fl»#©WSr£ATfc^i _ . 
[0100] m.^o-^Mz^.m-t^n.<r>^9 h/v 



[0101] fcfc^nlr^teffli-SglBfc&SfcfctjE 
[0 10 2] ±v&<0 t-f&#)} *tfmM*©»A>K:» 

[0103] ®fftf f — ^©fe*|jE*tT5iWrfc#feix*» 

[0 10 4] M^x-^A^^bfc^B«)ffi#-efc 
(Bt)Srffl^Tp(9)Sr*fe5r i:^-c#5 0 fcifcfi, 

[0105] fe*|jEo»iWrflir«tt*tfli*»#P< e ) t 

tX^^h, (6) Ict'Sft^-ffiv^rtdSt? 

[0 10 6] **Wofe*|jE*8cW:»*'K f*^ #9- 
Sfcfi, £r£L< 

[0107] m*&)teftm<vMi?ixte, zay-mnmm 

ik£htc&&m (ft t 7Lt£. L*a*b*feSW<Oa*b*3pffi) 
\zidi^X?rt>tvZ> 0 L^Llcc^D7r-</v^^^fE*q 
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£^Mf&ri 5 IS*n-c*fc£^}-t4, ff*Ktt:o»fB 

asfcjg-fb&Steffl ^ ' bin* 
[oio8] zz.x\ n^-yvyr^f^ttt. ttiti^ 

ttb<Dfeffl*5Labfltt?*>54i^tc:tt. :o*7-^d7 

[0109] HI 6 (a) r±*«WJwi5S*Wft»3Sft 
,1,— ^fcjjVf-gl-efcSo *3BW©fe«jEt*JV^X'?*— * 

fi£r\ g\ b'I^#6tl5. ^JxferofeffiSrfe^K^ 
U L*a*b*fetW«#fe*bS. «*fe*fc»±a®Oa*b*tt: 

(a) 0 6SIB«»«fc#feixfca*b*«[*s 

8ffl<Pa*b*fiti: — Si-Sd^iTp^SlB^tva. -feffilE 

fct x(4, H7#^t«S<t^- ^©i 5JwStSL-Cfi 
*?;frT J: t \, 
[0 110] 6*|jE»?*T*sJ:t^feffiMJClft»±, fettiE 

*b-T, Mflyi'-^'fcJs^T (<£•# 
[01 1 1] 0 6 (b) t>W^^7 f MlslcJ:«JKi4k 

&*-r„ hi 6 (a) ©«*w**aMbtea»::iiE»«)ia* 

-efdc^M^XHIi' '4, ftffllMHftW?c<» *7— v 

[0112] 

SL*a*b*fe{t* 5 # fctbS. ^LT0 6 (a) cD<t5tCl x 

#)a*b*) i:CDF^<D— &*^?fl^$H5 0 

[0 1131 *7-^^yh^tJPx.t, £fc(4 
ZOiXioV^. fe<£>H;L^gl£:E]6 (a) £/i»4 (b) 
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5 0 fe©Jlitaj»»4fe©a*.*-f f /i'Sr*i-. HI 6 (b) 
&;t54§£-tcf4, Sf&fi (£#&aiHb) £fc«4*ft±© 

[0114] @6 (b) ^S?* V hxy-^y 

10 SrMark FairchildO^S r#,cD JL?L*-'7 f A'£CIECAM97 
sj iC|S^^HTVSCIECAM97s ('Color Appearance Mo 
delingand CIECAM97s*. Tutorial Notes (CIC99), 199 
9,Armin Kndig) fci? CD&CDJL;t^X/V-?«£&X.5 £ 
i^fe©JL*.**Sra!*^li*iitfwi:jJSt'#*. -few 
Jl^:r/v£«-r£<DjL;t^«U4, feiliaotttJA 

[0 1 15] fcixfi, fe<t£Sr, Al!«iftI9JO«S 
(fci^-fi, A*/tfiD6 5) ^ ^T/w<AcoH*: 

LtbJ:^. fct?Lf4\ 

[0 116] *?|PJicJ:5fe*iE(4, AM«s-t01Sift^ 

so [0 1 1,7] Em*, ^PJO— o<0{H)SlC^oTttiE 

-5fe«3E^ew*jg^Slil&^(c:^-r o fifgl OOli 
iS^X-^^SfflL^ ^#^2 0 0-iriSSo Sff# 
IfclOOfi, fctxtf, ^xA^fctt^i/ M7-^T-fc 
otbiV\ m^Wi2 0 Oflfcirxtf, '>^<tt>- 

<, iS^/^^ — >SrWt) ST#©3 0 0 — ti^So fI9 
^T#© 3 0 0 (4^ y */tttlElg#a* ¥<F>&&^Wi 
4 0 0\ZT*-e*-r%. &f&^m4 0 0(4S*t-^fC 

^Sr#it)ST^3 0 Ot^^-rSo 
[0 118] #]0ST¥®3 0 0(4, a«J*lB«fe*fc 

*f4#Jt)^T#a3 0 0 4>bftSfa5 0 0 — ii£b*u 
-So »:«#S5 0 014, fct^Lli, ±xBwSii'(b>'V'-^ 

0 O^-iriMbHS. ^#!5!600liS{lfi5:l 00^ 
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[0 1 19] *3BW»-3*5E»*ft«afflO*tftt<)#jfe 

*ft&©4M£©IHJi*ll£W-**:*1-. r©*feii#«© 

[0 12 0] i©^«feOi*lljBtt:»fttt^HRO*tt"C 

fcitJ^OttWflWKttRfc*. 9 ©S#l 

tCfco-Ck^flrt-S., ftiH©. 6. iS.ttfMfc'-' 

5 ®&^* - x*»K1ltffK:#«E L#5 irt"*t©W«'< 
[0 12 1] £©J:5*H4fc''**-i4*ffl#afc"r«\ 2 

[0 12 2] fc£?ttf, -*^m^i*4fcl4feco«l 

P(image | object) ^ ^ 
P(image | non - object) 

[0127] *Sit (£&) <t I? t>A#v ^-a-tc 

[0 12 8] ^(0*Sit^3£(iBayesO^IIJ (MAPjfc^ 
8(1) tlRj^-CfolPx Pdmage | object) jSitfP (image 
| non-object) W^m* 5 IE«tT'fcixtf*ait^ 5c »T 

[oi 2 9] ^fc*5^r. #BHfe^ 

^-V^^^Mt^ (object) £fcf±#2t#i4&l (no 
n-object) iV>5fflf§"?*i% 
[ 0 1 3 0] P(image I object)*? J: TIP (image | non 

-object) o*-7vwffr£f^ t.tai^n&. 

l>\ fct^tf, HBK©^** 5 , (Gaussian) # 

^J^<D*\ i&TVs (Poisson) #*&©*», -tJxi t># 
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*vk©#A^-;*©1£#©&m3&ttaE?T UTffl^ 
**t&Ofe**Sitt*$H5. AIW©*fcf4fci:*.tf, 3E 

©^©^^-^©^Sr&ffl-rSJ:? lc1»j&£;h,T 
©/??£©*# £ Sr^-r^H^/^-^^m-f-S J: 5 lc 
[0 12 3] t£ot, ®^^->-*fcH«^®^©if 

[0 12 4] #«tt*fcfflv***H*tffe£M©ays«fc 

jgriH— <?*>*. rttb©^m«tt, s:w;rgfc3®& 
[0125] ^rift^— ^o«m«fc»Lr-tive^-o 

Ff5g©®^^^^ — V©iKft-ftP (image | object) CD^t" 
^->-^©^f:l£#©igi:f|-*P (image I non-object) 

[0 12 6] 

30 [g:3] 

r x = P( P on- object) ^ . 
^ P(object) J 

[oi3i] *>b*a*3inca^i-5**** 
40 tcJ; <9 5 > J:9 =>v/<^ KiSS^^Sb 

•9, ^fcCramer-RaoWT^-^r^Scf-yrSo 
[0 13 2] h^7A(0±^,^fi, ®^©^-M$r 

ffiV>S. wC"C#t^. APk(image | object) 

fe5Bff5e©^.«JH4pattern k {CjR-f-5^m©?i^Sr 
so Tifc, P attern k li^&iC^^i?©fo5)]l^$ 
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[0 13 3] Jt*5*fR©*ttOfll*«rtt*-*-5fc»fc 

P(image | object) = PI p k (pattern k | object) 



So 

[0 13 4] 
[ft 4] 



[0 13 5] 



58 m 5] 
P(image | noo - object )= fJPfcGMttern,, | non - object) 



■(8) 



■(9) 



[0 13 6] P(image | object) *S4TJ 5 P (image | non 

-ob ject) (Dittm * ma.* a br k « , * - a 

l£OV>Tt>, (pattern k ) i&Si&ff #JlC3&St LTI^S 

[0 13 7] »|t«J^*«:*45«ttK5M»-*-«fc«>fc 
|±, m*£(Di*©«iJ£{fiT*^^7vv£^&U £fti*© 

So -0©^ft©iK-a-BI#(- 4 5 £ 
— vSr^tt^fDittl^d^miJ-e^Si 5-e*>*u4\ ^ 
-g-;e-7vv£rffr&-f-S©;& 5 £fS Lv\, SMMS^Wfttfrft-fc 
tt, ^f^££<fMcL.ft^4 9f4, ^rtu^co^ft^^ 
3i$*T^/i'£fN<;-t~S ©£*$<?>< 4v\ 
[0 13 8] ftiaJ:if*©te©H«'<*— v-fco^Ttt 

*»±©«««r*i- J: 5 r 

[0 13 9] «*s±t5**r*Wi-*SK*#!P*»5fcH: 
#t©^#S* 5 fe5fcft> /WDgftS^giSc©^ 

So 

[0 14 0] Sfcv^fffl«5B8Sr*r«ti-SJRttf4ig5«|«lt? 
$>9, S, :|34tfD&i?©®©$feV**!r*r©IW*£*t 

3S£*b3JR'ttf4-t©to©£®&#;9 s ;o»9 SrftiSriiS 
T#S„ ftixtf, «T-v^f4\ IIS 4 9 fc$J<5VMBi4$ 
ftif©#asa»9T#>5. 

[0 14 1] SfeK* *f^S'J^S¥$tuSJS't±'b*>So 
ft£ ittf, *sp4W«K»*^Snfcjm4*fflv^ff » 
SEfc^ftlco^Tfc^^irJt^T, 
»i-S*mtB^i» 5 4 9 *:# < ft*. 

[0 14 2] ST, ttfcttSfcfiWjtv^-^SrSIWtt 



g, *, *54^Pfti*0«ttf-V7 p /H4^ofcmM^ 

[0 14 3] rwSat.t^tVT'^, ^r©te£T 
^D-V^Hc^f-rs^gSrfeiS^ir^T^So 
Tf4, =g-^-r r A'Wfc * b^A#®t£iMttteB©II)B# 
^^PPk (pattern^ (x, y) , x, y | object) *5 4 t/Pfc (patte 
rnj{(x, y), x, y | non-object) tftS„ P+t'&fix, y 
f4B^Mg{gi'>^K*::*£lc«U3rt-So ftft'U ^ 

$ * Mb fcfftatttte S 4 5 fH4ffi«»±S<fe 

©lD»3SMfe«T(4ft < , 4 9 tv«St?tlt?i £ i 
tWfigTfcSo 

[0 14 4] Sffi, JSft«*iJ:tf#ftfc»Brfl:Lfc»*£ 
JS t£ Sr ffrfci - S (4 , r h. h © &.tc \z mm -ft l ft If 
«sr, ^t-s^-e#s4 5»--rs^5i* s fes. ^©ft 

SHfeSr^M, J^^Sc, *J4U 5 *lfilH:pl^ftc«Bff'fk$ 
[0 14 5] aiB» JB«**S.ttf*fa~ ©#fl?fcH£fflTSI 

ugfc©!!**-^^ h^ftitT*(4ftt\ m.ny-y 

Mtowiis-e**. ftft'u rfrbw^&i-ifc^ 
T, ^i-^f^ hg£&T»4, K&flM0c©8t£*H<fe<Z>lD 
ffit^-fe^mtc-ifci-Sftfe, *anc«toTB4ftS:3te^ 
(cf¥#j^-rs^i:^x-#Sft«), 7bStt* s ft^o 

[0 146] ^U-y H^ttm^Sr^rplib^T^jl 

^icfc^T^fc'fti-S-^^V KfcH/fti-So 

K©®HF*3T*I4, filRis-tivfJxffilBtt^W^t U 
Tl^S, ^i-^^-y h^T*f4G. Strang*S4U ! T. Ng 
uyen^*© f $ x.'-'T* \s y V h~7 4 frZ 9 \ (Wave 
let and Filter Banks, ffellesley-Cambridge Press, 19 
97){CfE^$ttS4 5/3^{fil*B7^/U^/<^ 
^Sr^ffiLft3|^S^«H-4 9 1 Ofg©^^/^ KSrB 
8tc:^-r4 5«cf^fiK-f-So 

[0 14 7] ^tC*5V^T— oB^P»e»41 XV* — '?' 
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«^««**srt-. w* i <o»mt. mm 2 

«©4ffiF**U »Ji 2 3 
[0148] »*«tt»±» r©*5lfc:S<5^T*M£3;h, 

PgJg<DLH*5 it/HL/O KrtOSWWt-^»$*t7t 2x2 
[ 0 1 4 9 J £JBteliWPSgc<D'fg<D^£§tf AfrS r £ 

' h fl'& : ¥-ik<0&r& : & ft 0 t7h^7A 
oof >-cDgc£;fci: ;tfi, 1 0 0^<@*Sl^i-Sfc«>{- 
fi, x, y MM) KlttLTflHt-CWl OOiOlHWI* 

SE-Ti&^ifeSo -?r©7t*»Ctt, #ItIttl4lSI-8 

10 1 5 0J ±^W^fi, EtT©^W>- o<DXmz. 
[0 15 1] A : f^VKrt 

5o rcDi: 5#JW£tf 5 7{@ (o£9|5g«lLL. RUflLH, 
Pgjf 1HU ^S2LH. P£J12HU pgJf3LH, pg«3HL) ©-Jf 

[0152] b : wsam 
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t^/^KM (-T^fe*>s pgfSlLL— F»JS 1HU PtJflLL 
-^SlLH^ PgSlLH-pgJf2LH x pgglHL-pgJf 2HL, pgg 
2LH-pg/f3LH, pg^2HL-pg€3HL) Srffll/^"CS«lS*b 

[0153] C : jjfam 

R— OH*»/<^ KKUM-Stf, #3k<Ojjft'<>' KlcJR 

ijst^yw (i-*fc*>, PgSlLH-piSlHU R£Ji2L 
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CLAIMS 



[Claim(s)] 

[Claim l] How to amend a color containing at least one pattern space or an image pattern which has a 
color (memory color) of common knowledge which can be expected characterized by providing the 
following of photograph ** changed into digital representation (a) They are said at least one pattern space 
or existence of an image pattern and a location, and the step that detects a size preferably, (b) A step 
which measures the existing color which exists in detected said at least one pattern space or an image 
pattern (c) A step which supplies a value (memory color) of at least one substitute color relevant to said at 
least one pattern space or an image pattern (d) A step which replaces said measured existing color with a 
value of said at least one substitute color, and amends a color of said image pattern or an image field 
[Claim 2] A method according to claim 1 characterized by correcting a value of a pattern space which 
measured a value (memory color) of said at least one substitute color, and deflection between said existing 
colors, and was detected based on said deflection, or the existing color of an image pattern. 
[Claim 3] A method according to claim 2 characterized by correcting all the existing colors that exist in an 
image based on said deflection. 

[Claim 4] A method according to claim 1 characterized by measuring the average of said at least one 
detected pattern space or a color value of an image pattern, and using said average as said existing color. 
[Claim 5] A method according to claim 1 characterized by assigning said existing color which determined 
and measured a value (memory color) of said substitute color based on distribution of said at least one 
pattern space or a color value (memory color) relevant to an image pattern. 

[Claim 6] A method according to claim 1 characterized by opting for transform processing for changing the 
existing color value based on a value of said corresponding substitute color. 

[Claim 7] A method according to claim 1 characterized by using a value of a color after substitute as a 
value of the existing color, and amending the existing color of the repeat aforementioned pattern space. 
[Claim 8] A method according to claim 1 characterized by detecting a location of said pattern space or an 
image pattern by registering a basic pattern of a record object beforehand and detecting said basic 
pattern from said photograph. 

[Claim 9] A method according to claim 8 characterized by for said pattern space or an image pattern being 
human being's face, and said basic pattern being the face of human being to whom it was expressed with 
gestalten, such as a pic to gram. 

[Claim 10] A method according to claim 5 characterized by using color distribution acquired from said 



pattern space which has distribution of a color of common knowledge equivalent to a memory color which 
can be expected, and/or a color of common knowledge which can be expected. 

[Claim 11] A method according to claim 5 characterized by choosing one distribution judged to be in 
agreement with a value (memory color) of a substitute color corresponding to said existing color from two 
or more distribution. 

[Claim 12] A method according to claim 5 characterized by using additional information about record of 
lighting conditions, distance conditions, etc. as additional data used for color correction. 
[Claim 13] (a) A step which supplies at least one distribution group of a color value (memory color) in a 
predetermined color space, (b) A step which assigns one distribution to said at least one image pattern out 
of said distribution group, respectively, (c) A method according to claim 6 characterized by a color value of 
said at least one image pattern containing further a step which opts for transform processing for changing 
so that it may be in agreement with said assigned distribution. 

[Claim 14] A method according to claim 6 characterized by performing said method to a digital 
photograph which finally performed color correction repeatedly. 

[Claim 15] It is the method according to claim 6 characterized by to determine that transform processing 
will optimize a function which unifies mathematically whenever [ said coincidence / which a value of a 
substitute color corresponding to said existing color was determined according to optimization processing, 
and said optimization processing computed whenever / with a changed color value and a color value of 
assigned distribution in each pattern space / coincidence /, and was computed about each pattern space / 
all]. 

[Claim 16] Said distribution is a method according to claim 15 characterized by defining probability for a 
changed color value to express said substitute color, and computing whenever [ said coincidence ] based 
on said probability. 

[Claim 17] A method according to claim 6 characterized by determining that said transform processing 
will include vanity conversion of a color which models vanity of a color value of said image data by human 
being who looks at amended image data. 

[Claim 18] Equipment characterized by having (a) image data input section, (b) image-data-processing 
section, and the image data-logging section for recording (c) image data in an image processing system for 
processing image data, and said image-data-processing section performing a method according to claim 1. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] This invention is the the best for the face image of the 
digital representation which has the color of the common knowledge which can be expected especially 
about the method of amending the color of the photograph containing at least one pattern space. 
Furthermore, this invention relates to the image processing system which used the above-mentioned 
method. 
[0002] 

[Description of the Prior Art] A photograph is recorded by photograph recording devices, such as cameras 
(a still camera, an animation camera, a video camera, a digital camera, film camera, etc.). The image data 
of the photo intelligence told by light is picturized with these cameras, and is recorded by the reaction of 
the photochemistry material on semiconductor memory or a photographic film. Such account image 
transcription image information of an analog is digitized by scanning a film, using an analog digital (A/D) 
converter, and digital image data is obtained. The obtained digital image data is changed and is displayed 
by the output means (for example, a printer, print media, or a screen). 

[0003] There were many causes of the error which will be produced from the time of recording a 
photograph until it displays, or by the time [ in order to display later, ] it stores image data, and these 
errors affected image data and they had the problem that the color of the photograph finally displayed on 
a user differed from the original appearance of the object of a photograph. This invention relates to a gap 
of such a color. 

[0004] There are a technical factor and a factor depending on the method of the perception of the color by 
human being or an image as such an error or factor of a color gap. There are some which are depended on 
the spectral sensitivity of the chromatic aberration of a lens system, the color-balance algorithm of a 
digital camera, a CCD chip, or a film, an especially unsuitable color correction algorithm, etc. in a 
technical factor. The color of the object of the photograph taken with a camera changes with the 
spectrums of lighting. On the contrary, there is the feature of the so-called "homeostasis of a color" in 
human being's color correction function. 

[0005] The usual human being the color sample under the lighting condition from which plurality differs 
from which a color value differs, respectively The storage about a color value it is discriminable to 
reliance ("Measurement ofColor Constancy by Color Memory Matching" report "constant measurement of 
color by color memory matching": by Keiji Uchikawa and others --) Optical Review, Vol.5, No.l (1998), 



p. 59-63 - or - http://annex jsap.orjp/OSJ/opticalreviewyTOC ListsA^ol05/5a059tx.htm reference. It is 
because that human being has color vision also has a sensory mechanism of the homeostasis of a color. 
The color vision of the contents of the lighting used as the light source is relatively unrelated. On the 
contrary, it depends only on the spectrum of illumination light (tungsten light, flash plate light source, 
daylight, etc.) for the color value recorded with the camera etc. 

[0006] Furthermore, human being has memorized the color which is familiar in everyday life, for example, 
body warmth, foliage, a blue sky, neutral colors, or gray (for example, color of a road). In a CMYK 
(cyanogen, Magenta, yellow, and black) color space, the color tone of the white races' skin is 
13O40M-45Y-0K. These are values which are generally applied in the color of the skin of the young 
woman and child of the white races at least, the value of a Magenta and yellow is almost equivalent and 
cyanogen is usually about 1 / 5 - 1/3 of a value. [ of a Magenta and yellow ] When there are more values of 
a Magenta than yellow, redness is worn, and the hue of the skin wears yellow, when there are more yellow 
values notably than a Magenta. Black is contained only when the portion of the shadow of the skin or the 
color of the skin is deep (http^w ww.colorbalance.com/html/memory.html). 

[0007] In the photograph in which such a memory color exists, the memory color representing the 
characteristic color of a photograph can be used as a reference color of color correction. 
[0008] However, when searching two or more reference colors from there needs a big memory space very 
difficult in order to amend all the color data of the image no matter an object may be what digital image, 
there is a problem that computer operation will take time amount. 

[0009] In the field of image pattern automatic detection technology, it was a technical problem from the 
former to discriminate the image pattern which is a candidate for retrieval from the photograph which 
has a memory color. Such automatic detection is suitable when the defect which added correction or 
modification to image data, and was produced in the record process needs to be amended. For example, a 
possibility of having a different color from the actual color of a photography object is suitable for a high 
flash plate photography photograph etc. 

[0010] In addition, although there is a condition which the poor color tone of the photograph for which 
amendment is needed generates, below, automatic detection of the face image which applied discernment 
of the skin which consists of human being's memory color will be stated to details. 
[0011] 

[Problem(s) to be Solved by the Invention] In order to search flesh color and a face from a person 
photograph image, detecting flesh color first is known from the former. After detecting flesh color, it 
checks whether the image pattern of human being's face exists in the beige field. If a face is detected as a 
result, the color will be amended based on a memory color. However, the problem of being inapplicable 
was in the poor color tone of the image that such a process has a color the color of the skin on which the 
color of the skin is reflected to green, orange, or gray, that is, was recorded is not recognized to be as 
human being's skin. 

[0012] This invention aims at offering the color correction method of using the memory color of a specific 
image pattern as a reference color of the color data correction of a record image. This invention aims at 
amending the color of an image based on the memory color of body warmth especially. 
[0013] 

[Means for Solving the Problem] The contents of the standalone version type claim can attain the 
above-mentioned purpose partially at least. Moreover, a subordination formal claim explains a suitable 



example of this invention. 

[0014] The purpose of this invention is attained by method of amending at least one color of a photograph 
containing a pattern space or one or more image patterns which have a color (memory color) of expectable 
common knowledge changed into digital representation. According to an above-mentioned method, 
existence of at least one pattern spaces, such as human being's face, or an image pattern, a location, and 
an approximation- -for example at least size are detected especially. A color of the above-mentioned 
pattern space or an image pattern is measured, and a value (memory color) of at least one substitute color 
is related with the pattern space or an image pattern. 

[0015] A color of the above-mentioned pattern space or an image pattern is amended by a value of this 
substitute color being equivalent to the so-called memory color, and replacing the measured existing color. 
According to this invention, human being can reconfigurate or amend a different image pattern from a 
certain specific imagination color maintained at storage, or the poor color tone of a pattern space on the 
basis of human being's memory color. According to a method of this invention, it is necessary to register at 
least one substitute color or a memory color about each of pattern spaces, such as human being's face, or a 
pattern image especially. 

[0016] Since an image pattern of a class which is [ grass / a face, a road, or / green ] different may be 
searched from two or more record images, for example, it is necessary to register at least one substitute 
color, i.e., human being's memory color, about each of these image patterns. Therefore, two or more 
pattern spaces or image patterns are detected from one photograph, i.e., digital representation of the 
photograph, and it becomes possible to replace with a memory color which human being maintains at 
storage to a substitute color which registered a defective color of these image patterns, i.e., the image 
pattern. 

[0017] According to one suitable example of this invention, it is also possible to ask for deflection between 
a value of at least one substitute color, and a pattern space which performed discernment and localization 
or the existing color of an image pattern. Based on this deflection, a detected pattern space or the existing 
color value of an image pattern is correctable. Therefore, a color of a detected image pattern is not 
replaced by only a substitute color or memory color 1 color, but only a part of deflection is corrected. That 
is, after color correction will have two or more colors, and, as for an image pattern, will have more natural 
appearance. Furthermore, it is also possible to use this deflection, and to correct or amend all the existing 
colors of an image. 

[0018] Furthermore, the average of at least one detected above-mentioned pattern space or a color value 
of an image pattern can be calculated, and this average can be used as an existing color in all subsequent 
color correction processings. 

[0019] Of course, it is also possible to use distribution of a color value relevant to one or more memory 
colors related with a pattern space or an image pattern. In this case, a value of a substitute color 
corresponding to the measured existing color is assigned. 

[0020] Furthermore, since it may consist of mutually different color values in specific color spaces, such as 
a HSV color space, when it has a value of a color value from which a value or a memory color of the 
above-mentioned existing color and an assigned substitute color differs mutually, for example, specific red, 
green, and blue, respectively or, transform processing may be needed in order to amend a color value of a 
subject-copy image of digital representation. Suitable transform processing enables it to amend 
appropriately in consideration of all color values about a certain color. 



[0021] Another example of this invention is based on recognition of one or more image patterns of human 
being's face or a road. These image patterns contain a certain specific color which human being 
memorizes. Moreover, these image patterns are comparatively detectable from digital representation of a 
record image with this example in a short time. Memory colors, such as a color of the skin, are contained 
in image patterns detected comparatively easily, such as human being's face. It is possible to amend a 
color of a photograph based on recognition of a specific color with an image pattern with which a certain 
specific image pattern was recognized and detected. This is realizable by amending all colors of an image 
in consideration of deflection between a color detected from a detected image pattern, and a memory color 
predicted that human being perceives from an image pattern detected [ road / a face, ]. 
[0022] Which existing image pattern detection method may be used for this invention. Anything may be 
used for detection of an actual face as long as it is the system which agrees moderately below. For 
example a paper "face detection by neutral network" ("NeutralNetworkBased Face Detection" and PhD 
Thesis CMU-CS -99-117 -•) of Henry Rowley A neutral network method indicated by Carnegie Mellon 
University and Pittsburgh 1999, Or Schneiderman's and others paper "a statistical method used for 
three- dimension body detection of a face, a vehicle, etc." 0 [ "A Statistical Method for 3D ObjectDetection 
Applied ] to Faces and Cars", the wavelet technique indicated by Proc.CVPR 2000, Vol.1, p.746-752, and 
Hilton Head Island2000 can be used. 

[0023] It is that probability ** which will be detected if a face is for important one not to have that 
detection of a face is performed automatically completely, that detection speed is moderately quick, and a 
rate of false positivity, i.e., a face, here is low. Here "it is moderate" changes with conditions of a gestalt of 
operation. Contents indicated by the above-mentioned reference by Rowley, and Schneiderman and others 
shall be included in an example of this invention. 

[0024] To rotation, since it is not eternal, it is necessary to devise ability to detect of almost all face 
detector so that detection can be ensured about all hands of cut that a face can take. The method changes 
with detectors used since rotation permanence changes with face detectors. For example, by the 
technique of Rowley, rotation permanence is acquired in about **45 degrees in the technique of about 
**15 degrees and Schneiderman. Therefore, it is necessary to secure rotation permanence with means 
other than a. detector. After this carries out preliminary rotation of the image, it can be attained by 
performing after treatment and the usual face detection. 

[0025] For example, four phases are required for a system using a face detector of Schneiderman. In other 
words, in the case of the above-mentioned face detector, it is necessary to reach, to rotate 270 degrees and 
to measure 180 degrees of 90 degrees of 0 degree of images, respectively. 

[0026] If a face is detected, a range which searches flesh color will be limited remarkably. According to an 
above-mentioned detection method, a direction where boundary attachment **** and a face are rough is 
[ a face ] detectable. Generally ability to detect of a face detector is not rotation permanence as 
above-mentioned. Therefore, the direction of a face can be searched for within limits limited by the 
rotation permanence of a face detector. In the case of a Schneiderman detector, this range becomes less 
than **45 degrees. 

[0027] After finishing localization of image patterns, such as a face or a road, a color of a photograph can 
be amended according to the next step of a method by this invention. To an image pattern which carried 
out the localization, since color distribution of a color corresponding to detection and all image patterns by 
which the localization is carried out is beforehand registered by image processing system which existence 



of a certain specific color is predicted, and operates according to a method by this invention, it can check 
at it whether a possibility that a color detected from an image pattern corresponds is within the limits of 
the highest color distribution, respectively. As mentioned above, it corresponds to a memory color 
predicted that human being memorizes these color distribution, and human being perceives it from 
localization and a detected image pattern. 

[0028] That is, for digital representation of a recorded image, a method by this invention identifies human 
being's one pattern space or image patterns, such as a face, and detects the above-mentioned pattern 
space on a photograph, i.e., digital representation, or a location of an image pattern first. And a color of 
common knowledge which detected a location and which can expect the above-mentioned pattern spaces, 
such as a face, or an image pattern, for example is determined. 

[0029] Next, at least one distribution of a color value in a certain color space corresponding to a color 
determined about the above-mentioned pattern space or an image pattern is selected, the above - even if 
few, from distribution of one color value, one color value corresponding to a determined color is 
determined, and it is assigned to a color of the above-mentioned pattern space. An assigned color value is 
equivalent to a color which can be expected by human being. That is, having the pattern space, for 
example, a face, and a color of **** needs to exist in storage of human being. And deflection between a 
color of the above-mentioned pattern space and a color value of the assigned above-mentioned 
distribution is called for, and it opts for transform processing for changing a color of a photograph from 
this deflection. Color data of digital representation of the above-mentioned image is amended by this 
transform processing. 

[0030] Repeat activation of according to claim 1 step (b) - (d) may be carried out using a color value which 
corresponds from the above-mentioned distribution. In that case, in a step (b) of claim 1, a color value 
determined as a value to assign surely replaces a color value replaced with the existing color or the last on 
a pattern space or an image pattern. It will be stopped if it is judged that this repeat has in tolerance the 
color value amended at the last of a pattern space identified and detected or an image pattern. A 
possibility is most equivalent to a high portion of at least one distribution chosen as distribution of a color 
value in a predetermined color space where this tolerance has a high possibility of being most in 
agreement with a color detected from a pattern space or an image pattern set as the object of color 
correction. 

[0031] Of course, since a desirable result, i.e., a color value in tolerance, cannot be obtained in 
predetermined time amount, when a method by claim 1 cannot be ended, it is also possible to choose 
another color value distribution in same color space near color value distribution of a color space used last 
time etc., and to acquire a color value in tolerance based on this another color distribution. 
[0032] For example, when it is judged that a colored spectrum and/or a HSV value of a HSV color space 
where an average color detected from discernment and a pattern space which carried out the localization, 
or an image pattern differs from the range of a high color value of a possibility that it is most in 
agreement within a certain selected color distribution are included, it is possible to calculate this 
deflection. For example, deflection may be in red, green, a blue color value, and a hue. 
[0033] A total color in a photograph, i.e., digital representation of a photograph, can be amended from 
such calculated deflection. It is detectable again after amendment whether discernment and a pattern 
space which carried out the localization, or a color value of an image pattern is within the limits of a high 
portion of a possibility that selected color distribution is most in agreement about this amended digital 



representation. It is equivalent to distribution of a color value considered that human being predicts this 
color distribution based on storage of a color. 

[0034] Therefore, according to this invention, it is possible to amend a color of the whole record image 
automatically from one existing specific pattern spaces, such as a face, or a color of only an image pattern. 
[0035] According to a method of this invention, color correction of a digital photograph can be performed 
and a memory color can be reproduced the optimal. Especially this invention is applicable to a DMD 
printer for photographs, an ink jet printer for photographs, a CRT printer for photographs, a development 
print system of a photograph, a small development print system especially called a "mini-laboratory." 
[0036] The above-mentioned printer or a development print system processes supplied photograph 
information. Although photograph information may be supplied as photograph information on a film as 
usual, it may be supplied by digital method through networks (the Internet, LAN, etc.) or storages 
(CD-ROM, a disk, memory chip, etc.). 

[0037] A color used as reference of color correction by this invention is called a "reference color." Generally 
these reference colors are equivalent to a memory color, and represent a characteristic color of main 
portions of an image in almost all photographs, therefore, such a characteristic color (memory color) - for 
example, you may draw from two or more selected photographs by photograph expert statistically. A 
model of a characteristic color (memory color) is drawn from two or more above-mentioned photographs, 
and a color value with which a characteristic color (memory color) is considered to usually have is 
acquired from this model. The above-mentioned color value can be used in a form of color value 
distribution where likelihood of a specific color value is expressed. 

[0038] One memory color considered that it was not the color value which is one, but an artificer of this 
invention was what is expressed with two or more color values in fact. This invention can express two or 
more color values showing a specific memory color (characteristic color) using at least one distribution. 
This distribution shows distribution of two or more color values which can be set to a specific color space. 
Especially the above-mentioned distribution expresses a range or a portion of two-dimensional [ in a color 
space ], or a three dimension. The above-mentioned distribution does not necessarily relate to a location 
in a color value, i.e., a color space, and a chisel, and relates also to one or more parameters of two or more 
color values expressed by the above-mentioned distribution. 

[0039] For example, this parameter is a parameter about probability for a certain color value to express a 
specific memory color. For example, this probability can be presumed from statistical abundance of that 
color value in two or more photographs. By this example, the above-mentioned distribution means 
probability distribution. According to another example, the above-mentioned parameter is a parameter 
showing a weighting factor used for amendment processing. This weighting factor shows significance of 
each color value used for an expression of a certain memory color. Usually, significance of a color value is 
so high that the above-mentioned statistical abundance or the above-mentioned probability is high. 
[0040] Moreover, when there is additional information about image pick-up conditions, it is also possible 
to use further distribution from which plurality differs to the same memory color. For example, if 
information that an image was photoed using a flash plate is registered into a digital camera, it is 
possible to use distribution which is adapted for flash plate photography conditions, or distribution 
acquired from two or more flash plate photography photographs instead of standard distribution. 
Standard distribution is distribution which is adapted for all image pick up conditions (daylight, the flash 
plate light source, indoor, etc.). 



[0041] However, when there is no additional information, it is desirable [ such additional information / it 
is desirable to use in the so-called decision of "prior information", therefore ] to assign only one 
distribution to one memory color, so that it may explain below. According to this invention, a memory 
color is used as a reference color. Preferably, a reference color group and two or more distribution which 
follows and corresponds to them are supplied. It is also possible for fixed data about these distribution to 
be registered into the memory section, to be able to access now through a network if needed, and to 
update based on a new statistical data, for example. 

[0042] A color correction method or color correction equipment by this invention receives and amends 
image data showing a photograph. Image data receives by digital method through a storage or a network 
preferably. Instead of or in order that color correction equipment by this invention may generate digital 
photograph data further, you may have a scan means to scan a photographic film. 

[0043] A vector of a three dimension which is usually digitized, for example, consists of an integral (for 
example, 0...255) component can express a color value of a record image. It is possible to express a color 
value using color spaces, such as RGB, sRGB, CMYK and Lab, and CIELab, in order to obtain digital 
representation of an image. 

[0044] According to this invention, distribution (or selected distribution) corresponding to a reference 
color and/or it is assigned to detection and a pattern space by which the localization was carried out, or an 
image pattern. Distribution assigned is chosen from the existing distribution group. 

[0045] It opts for transform processing based on distribution assigned to an image, i.e., a reference color 
assigned to an image pattern, (memory color). Conversion means actuation of image data aiming at 
amendment, and it opts for it based on a color value which exists in an image pattern. The existing color 
value expresses an origin of conversion and assigned distribution defines an end point of conversion. It is 
the purpose to make it in agreement with a color value as which distribution which was able to be 
assigned expresses a color value of an image pattern, i.e., a color value predicted that human being is 
there. 

[0046] transform processing for which it opted - using - a color value of image data - a color value of all 
image data is changed preferably, and an amendment image is acquired. This amendment is performed 
based on distribution showing information about a typical memory color which exists in a photograph. 
Since a memory color is expressed by not a strict color value but distribution, "whenever [ fuzzy ]" is 
obtained by principle of color correction of this invention. Optimization processing whose flexible and 
smooth amendment is attained by whenever [ this / "whenever / fuzzy /" ] can be performed. 
[0047] And it means that two or more "coincidence" steps of claim 1 which were mentioned above in the 
following cases were attained. A color value from which a reference portion was changed this the account 
of a top When subspace of a color space occupied according to the assigned distribution is resembled, 
When a portion with highest possibility of distribution as which a changed color value was chosen from 
conversion before is resembled, When the at least 1 section of a changed color value is within the limits of 
the above-mentioned subspace of the above-mentioned color space, it is the case where most color values 
of a changed image pattern or all is within the limits of the above-mentioned subspace of the 
above-mentioned color space. "Whenever [ coincidence ]" is equivalent to a degree of a lap or 
approximation in comparison with a color value before conversion. By desirable method, evaluation of 
whenever [ coincidence ] can be performed to a pan which took probability into consideration by 
performing optimization processing. This method is explained below at details. 



[0048] A probability model is preferably applied to a memory color, namely, distribution of a color value -- 
probability - further -- desirable - conditional -- it is defined by probability, conditional - probability 
defines likelihood of a color value under conditions of a certain specific memory color (reference color). 
Each memory color model, i.e., probability distribution of each memory color, may be drawn from a 
training data constellation offered by photograph expert, or it may be acquired by statistical analysis of 
two or more photographs. Furthermore, the quality of coincidence between a changed color value and a 
color value defined according to the above-mentioned probability distribution can also be evaluated using 
the above-mentioned probability distribution. A thing of the quality of coincidence can be called 
"whenever [ coincidence ]." For example, you may think that whenever [ coincidence ] becomes high, so 
that probability for a changed color value to be equivalent to a memory color is high. This probability is 
calculable from probability distribution. 

[0049] That is, evaluation of whenever [ between a changed color value and a color value of assigned 
distribution / coincidence ] is preferably used for optimization processing by this invention. Whenever 
[ this coincidence ] is calculable using probability distribution as above-mentioned. When the 
above-mentioned probability distribution specifies subspace of a color space, a lap degree between 
subspace specified with a color value of a reference portion and subspace specified according to the 
above-mentioned probability distribution can be used as whenever [ in optimization processing / 
coincidence ]. Optimization processing is performed so that "whenever [ this coincidence ]" may become as 
large as possible. 

[0050] It asks for whenever [ as which an image pattern expresses the quality of synthetic coincidence 
between all image patterns and an assigned memory color when two or more and/or two assigned 
distribution or more exist / "whenever / all / coincidence /" ] from whenever [ according to two or more 
desirable individuals / coincidence ]. Whenever [ according to these individuals / coincidence ] is 
equivalent to whenever [ between a color value of one image pattern, and a color value of distribution 
assigned to the image pattern / coincidence ], respectively. Whenever [ above-mentioned all / coincidence ] 
is a function which consists of whenever [ according to two or more desirable individuals / coincidence ]. 
The above-mentioned function unifies mathematically whenever [ according to the above-mentioned 
individual / coincidence ] still more preferably. 

[0051] a case where probability distribution is applied - each image pattern - receiving - conditional - 
probability is calculated, conditional - probability expresses probability for a color value of image 
patterns, such as a face, to belong to a memory color assigned to the pattern, conditional [ corresponding 
to two or more image patterns which chose evaluation of "whenever / all / coincidence /" preferably / two or 
more ] -- it is carried out based on a product which means an above-mentioned function, a product, i.e., 
this example, of probability. 

[0052] Moreover, when applying probability distribution, since it is based on probability, "whenever 
[ coincidence ]" can also be called "coincidence probability." Coincidence probability expresses probability 
for a changed color value to belong to distribution or a reference color assigned to the image pattern. 
[0053] Coincidence probability is preferably searched for based on distribution which defines probability 
for a color value of an image pattern to express a reference color. You may ask based on instead of or effect 
of further as opposed to a color value (systematic) of image data for coincidence probability. With this 
effect, what was generated from what was generated when a photograph was photoed (for example, thing 
to depend on a spectrum of lighting for photography objects, such as the flash plate light source) by the 



time image data was received by a color correction method or color correction equipment by this invention 
is included. Such information about systematic effect is also called "prior information." "Prior 
information" is later explained further to details. 

[0054] It is also possible to perform color correction only based on information about saturation and a hue. 
When it expresses a color value as a Lab vector, it can also amend only based on a vector value of a and b. 
Such automatic selection, assignment, and the main advantages of amendment are to be able to amend 
certainly also about an image with which distortion of a color exists intentionally. This is because 
selection of an image portion and assignment of distribution (or corresponding reference color) are 
performed without being dependent on a hue and information about saturation. 

[0055] Of course, it is also possible to add to a face, or to detect and choose them instead of a face, using 
other objects as an image pattern. For example, a reference color becomes gray in using a road as an 
image pattern. 

[0056] It turns out beforehand that it is sent to output means (for example, a printer or a mini-laboratory 
etc.) with amended image data, and this can be used for a step which opts for transform processing, 
especially corresponding optimization processing when color management profiles, such as an ICC profile 
of the international color committee (International Color Consortium, http://www.color.org) convention, 
are known. In this case, it opts for transform processing so that transform processing may include color 
management conversion corresponding to a color management profile of an output means. 
[0057] Amendment may be performed instead of a pan from a viewpoint of color vision of an image by 
human being. For this reason, a vanity model of a color like CIECAM97s in reference "vanity model 
creation of a color and CIECAM97s" ("Color Apperance Modeling and CIECAM97s", Tutorial Notes 
(CIC99), 1999, Armin Kndig) of Mark Fairchild may be used. A vanity model of a color can be expressed 
by transform processing, i.e., vanity transform processing of a color. It is determined that transform 
processing used for amendment by this invention will include vanity transform processing of such a color. 
[0058] This invention relates not only to a method but to a program and a computer storage equipped 
with the program. Furthermore, this invention relates to a photograph processor which performs 
above-mentioned amendment processing. Such a photograph processor has a conversion means for 
performing a decision means for opting for transform processing in consideration of whenever [ quota 
means / for assigning distribution of a selection means for choosing an input means for receiving a 
memory means for memorizing distribution, and digital image data, and a reference portion, and these 
reference portion /, and above-mentioned coincidence ], and amendment conversion. 

[0059] Such a photograph processor may be realized by an ASIC product, electronic parts by which hard 
connection was made and/or a computer programmed according to this invention, or chip. Furthermore, 
this invention relates to a photograph printer using an above-mentioned method of constituting an 
above-mentioned photograph processor or a photograph development print system, especially a 
mini-laboratory. Each equipment may be equipped with data-processing means, such as a computer by 
which an above-mentioned program was executed or incorporated. 
[0060] 

[Embodiment of the Invention] The principle of the method by this invention is explained below at details 
in relation to face detection of human being and skin detection of a face. Though natural, another image 
pattern with which other memory colors exist may be detected. 

[0061] Anything may be used for actual face detection as long as it is the system which agrees moderately 



below. For example the paper "face detection by the neutral network" ("Neutral Network-Based Face 
Detection" and PhD Thesis CMUCS -99117 -) of Henry Rowley Carnegie Mellon University, a neutral 
network method given in Pittsburgh 1999, Or Schneiderman's and others paper "the statistical method 
used for three-dimension body detection of a face, a vehicle, etc." 0 [ "A Statistical Method for 3D Object 
Detection Applied to ] The wavelet technique Faces and Cars" and given in Proc.CVPR 2000, Vol.1, 
p.746-752, and Hilton Head Island2000 etc. can be used. 

[0062] It is that probability ** which will be detected if a face is for important one not to have that 
detection of a face is performed automatically completely, that detection speed is moderately quick, and 
the rate of false positivity, i.e., a face, here is low. Here "it is moderate" changes with conditions of the 
gestalt of operation. In the example of this invention, the contents indicated by the reference by Rowley, 
and Schneiderman and others are adopted. 

[0063] To rotation, since it is not eternal, it is necessary to devise the ability to detect of almost all the face 
detector so that detection can be ensured about all the hands of cut that a face can take. The method 
changes with detectors used since rotation permanence changes with face detectors. For example, by the 
technique of Rowley, rotation permanence is acquired in about **45 degrees in the technique of about 
**15 degrees and Schneiderman. Therefore, it is necessary to secure rotation permanence with means 
other than a detector. After this carries out preliminary rotation of the image, it can be attained by 
performing after treatment and the usual face detection. Drawing 1 is a flow chart explaining such face 
detection. 

[0064] For example, four phases are required for the system using the face detector of Schneiderman. In 
other words, in the case of the above-mentioned face detector, it is necessary to reach, to rotate 270 
degrees and to measure 180 degrees of 90 degrees of 0 degree of images, respectively. 
[0065] If a face is detected, the range which searches flesh color will be limited remarkably. According to 
the above-mentioned detection method, the direction where boundary attachment **** and a face are 
rough is [ a face ] detectable. Generally the ability to detect of a face detector is not rotation permanence 
as above-mentioned. Therefore, the direction of a face can be searched for within limits limited by the 
rotation permanence of a face detector. In the case of a Schneiderman detector, this range becomes less 
than **45 degrees. 

[0066] Drawing 2 and 3 are rough pictograms used for discernment and/or the localization of the image 
pattern for retrieval. Of course, these may be rotated, inclined or moved, and a memory color may be 
identified. Here, a memory color is equivalent to the color of body warmth. 

[0067] In order to identify an image pattern, processing which makes the feature of a face emphasize may 
be performed. For example, histogram normalization, partial contrast enhancement, etc. may be used. 
[0068] Next, in one side of this invention, a pattern space or an image pattern will enable it discernment 
and to detect the color in this field, if the localization is carried out. According to the detected color, the 
memory color used as a substitute color used for the image pattern detected at least is chosen. 
[0069] The possibility of coincidence is possible also for determining the deflection between the highest 
memory color and the color measured in recognition and the image pattern by which the localization was 
carried out from the image with which it is set as the object of amendment. From this deflection, all the 
colors of the remaining portion of not only the color correction of an image pattern but its image can be 
amended. The possibility of coincidence can determine the highest memory color by detecting one color 
based on [ of the detected image pattern ] presumed as an existing color value, or calculating the average 



of the color of the detected image pattern, and asking for the deflection of the memory color near this 
existing color value, and the existing color value in specific color spaces, such as a HSV color space or a 
RGB color space. 

[0070] Although it is also possible to apply more complicated processing, and a better color correction 
result is obtained on the other hand in this case, on the other hand, time amount required for amendment 
processing will become long. 

[0071] The color correction method or color correction equipment by still more nearly another side of this 
invention is explained below. 

[0072] A memory color is defined by the normalized color space. Furthermore, as mentioned above, it is 
also possible to combine a color management model and/or the vanity model of a color with color 
correction processing so that it may state to details by the following. 

[0073] As input data of this method, at least one image pattern i on an image (i = 1 ... N) to which the 
digital image (for example, obtained usiug the digital camera or the scan means) and the memory color Ai 
were assigned is used. A pattern space or an image pattern is the location, for example, the Cartesian 
coordinate. It is discriminable with xi/yi. The image pattern which is a reference portion consists of one or 
more pixels (pixel). The number of the image patterns to be used is N. The image data in each image 
pattern is characterized with a characteristic color value. 

[0074] When an image pattern consists of two or more pixels, the color value assigned to this image 
pattern may be a function which consists of two or more color values of two or more pixels of that image 
pattern. Although this function may be the median of the color value of these pixels, it may enlarge 
weighting to the color value of a core compared with the color value of the pixel in the periphery section of 
an image pattern, for example. The color value (for example, function which consists of two or more color 
values of two or more pixels of an image pattern) of an image pattern may be expressed using color spaces, 
such as RGB. In that case, the color values of the image pattern i are ri, gi, and bi. 

[0075] When specifying the point on an image and identifying an image pattern, the image pattern may 
be equivalent only to the pixel of the point. This image pattern may be matched with the average of the 
field of the fixed size centering on that point. This field carries out field growth of the seed whom the user 
specified according to the pattern recognition method of this invention, and may be obtained. 
[0076] If the substitute color equivalent to the existing color value of input data, i.e., an image pattern, 
and an image pattern and the aim color value of an image pattern gathers, it can opt for the conversion T 
for color correction. Although Conversion T is strange at first, a definition can be given like a degree type. 
[0077] 

[Equation l] 
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[0078] Although the color value is expressed with the formula (l) as r, g, and b, this is an example and 
may choose other displays, for example, a Lab color coordinate system, a formula - (•• one ■-) - conversion 
-- T r g -- b *• a value - being new - a pixel value - r - ' - g - ' - b - ' - changing - having . Moreover, 
more complicated conversion may be used if needed, the example of conversion - G.Wyszecki and a 
W.Stiles work - color science: it is indicated by concept, method, quantitive data, and formula" (Color 



Science :"Concepts and Methods, Quantitative Data and Formulae", Wiley, 1982). For example, the 
following transform processing may be performed. 

[0079] A scale factor is simply applied to Above r and g and b value. Such amendment is applied to a 
digital camera in many cases. In this case, Conversion T is a diagonal matrix by which the component of a 
matrix is equivalent to a multiplication factor. 

[0080] A color value is changed into another color space from a certain color space. For example, after 
changing r, g, and b value into the value of XYZ color specification, a scale factor is applied to X, Y, and Z 
value. The color value of an image pattern is desirable, and one dimension expresses brightness or 
lightness and is changed into the color space where the dimension of others which the dimension became 
independent of expresses a hue and a color tone. 

[0081] By conversion, r, g, b value, or other color values are changed into an LMS cone response value, 
and a scale factor is applied to the acquired value. 

[0082] In either of the above-mentioned color spaces, general matrix transform processing of 3x3 is 
performed. A matrix expresses the rotation in a color space, deformation, or displacement. When one 
dimension of the color space expresses brightness or lightness especially, you may change by fixing the 
value of brightness. For example, conversion may be a matrix showing rotation centering on the shaft of 
brightness or lightness. 

[0083] The model of the memory color relevant to distribution of the color value corresponding to a 
memory color is a probability model. Each memory color Ak (Al= neutral colors or gray, an A2= blue sky, 
A3= body warmth, A4= foliage) is defined by the likelihood. 
[0084]p(a,b|Ak)... (2) 

[0085] A formula (2) expresses a possibility that the color value expressed with Parameters a and b 
belongs to a memory color. In the example explained below, it is assumed that these parameters a and b 
are equivalent to the components a and b of a Lab vector, a formula (2) - conditional - it is probability 
and the probability of the color values a and b under the conditions of a memory color Ak is expressed. 
[0086] A formula (2) can be made into the thing of a form complicated to a degree required to express 
training data, such as a statistical analysis result of the memory color in two or more photographs. A 
desirable result will be obtained if a two-dimensional multivariate Gaussian curve expresses probability 
distribution. Drawing 4 shows the example of the memory color model (probability distribution) of 
"neutral colors" (continuous line), a "blue sky" (dashed line), "body warmth" (dotted line), and "foliage" 
(one-point dashed line). In drawing 4 , a Gaussian curve shows the line by which the highest probability 
of each memory color becomes 50%. That is, it is p(a, b I Al) = 0.5 to all the color values (a, b) on the 
continuous line of drawing 4 . 

[0087] Below, the optimization method or algorithm which asks for transform processing from which 
coincidence with the color value which the image pattern changed, and the color value of the probability 
distribution of the substitute color assigned to the image pattern serves as the highest is explained. 
[0088] Conversion T is characterized with the parameter (for example, scale factors rf, gf, and bO showing 
the diagonal element of 3x3 matrix of a predetermined number. If an image pattern and its color value 
are detected, pixel r'i, g'i, and b'i which were changed will determine these parameters from the input 
color values ri, gi, and bi of the image pattern i which performed detection and the localization so that the 
corresponding memory color Ai may be reproduced the optimal. 

[0089] The "optimal" degree here may be defined using the a b color plane of CIE 1976 Lab color space. 



The component of CIE 1976 Lab color space can also be expressed as L*, a*, and b* (refer to drawing 4 ). 
These components relate to a CIELab color coordinate system. K. It is indicated by the psychology paper 
"the quantum nature of a memory color color rendering" ("The Quantitative Aspects ofColor Rendering for 
Memory Colors", in 1ST PICS2000 Conference, p.94-98, 2000, MS) by Toepfer and R.Cookingham that it is 
suitable for CIE 1976 Lab color space defining a memory color, therefore a substitute color. 
[0090] a of the image pattern i and b value are calculable with a degree type using certain conversion 
Ttheta (theta expresses the parameter of the transform processing). 
[0091] 

a'i^aO-'i, g'i, b'i) =fa (Ttheta (ri, gi, bi)) ... (3) [0092] 

b , i=fb ( r . i gli b<i ) =fb (Ttheta (ri, gi, bi)) ... (4) [0093] In a formula (3) and (4), fa and fb express the function 
for calculating a in the RGB (for example, sRGB or Adobe RGB) color space to be used, and b value. 
[0094] All probability is calculable if needed using the probability distribution defined by a'i, b'i, and the 
memory color model (2), i.e., a formula. All the probability acquired as a product of each probability can 
take all image patterns into consideration. 
[0095] 

[Equation 2] 



[0096] On the whole, aU the probability p (D I theta) expresses the probability to express the memory 
color by which the color value from which all image patterns were changed was assigned to the image 
pattern, respectively. Parameter D shows the color value of input data, i.e., an image pattern, and an 
image pattern, and the substitute color assigned to the image pattern, therefore, conditional [ of input 
data / probability / (D I theta) / p / all / D under the conditions of the conversion parameter theta ] -• 
a-priori probability is shown. 

[0097] according to the formula of Bayes ■- conditional -- a-posteriori probability is acquired by the degree 
type. 

p(theta|D) ** p (D I theta) -p (theta) ... (6) [0098] A-posteriori probability p (theta I D) The probability of 
the conversion parameter theta under the conditions of input data D is expressed. That is, the conversion 
parameter theta shows a chance of expressing right transform processing. For this reason, p (theta I D) It 
becomes the above-mentioned scale of "whenever [ coincidence ]." Color correction can be optimized based 
on this a-posteriori probability. Optimization can be performed by calculating the maximum of a formula 
(6). When a memory color model and a prior model are multivariate Gaussian curves, this probability is 
convex and that maximum can be efficiently calculated by the inclination method of descent. The 
inclination method of descent is the optimization method (numerical calculation) used for a nonlinear 
function, and is a method of moving to a serially more low (more high in this example) point in retrieval 
space, and calculating the minimum value (this example maximum). 

[0099] The above-mentioned prior information p about the color correction of image data (theta) may be 
general information or the information depending on an image. The example of "general" prior 
information is shown below. 

[0100] It is the information on the film of the specific class scanned in order to obtain the feature and 
digital image data of the spectrum of the equipment used for an image pick up process or the feature of a 



color, for example, the spectrum of a digital camera, and a color ete. For example, a digital camera may 
have a systematic bias characteristic of color sensitivity. 

[0101] It is the information about the degree of amendment required for the equipment used for an image 
pick up process, for example, compared with other digital cameras, the need for color correction is high - 
like - it is information. 

[0102] It is also possible to use, the information, for example, the prior information "depending on an 
image", on other other than above-mentioned "general" prior information. The example of this prior 
information "depending on an image" is shown below. 

[0103] It is the information about the feature and/or defect of an algorithm required for image data 
processing which are acquired before performing color correction of image data. For example, in 
processing based on an automatic color correction algorithm or the constant algorithm of a color, the 
precision of these algorithms is known and equivalent to prior information. When the precision of these 
algorithms is known, the maximum of the degree of the color correction by this invention which 
determines p (theta) can be presumed. 

[0104] It is the additional information presumed from image data. For example, an image is classified, 
and since there is a predetermined systematic bias, p (theta) can be decided to be the vanity of the color of 
the image belonging to a certain specific kind using this bias. For example, you may classify in the image 
of evening glow, a portrait image, etc. 

[0105] The prior information on color correction is always expressed as probability distribution p (theta), 
and it can use for presumption by the formula (6). 

[0106] The color correction method of this invention is preferably used together with the color 
management method or the color correction equipment of this invention preferably equipped with the 
color management means. The above-mentioned optimization processing of conversion is the optimization 
which used the forward direction model in principle. That is, the color conversion T is changed until a 
modification (conversion) color value is in agreement the the best for the color value of the color 
distribution corresponding to the model, i.e., the substitute color, of an ideal memory color. 
[0107] In a fundamental work flow, this coincidence is performed in the standardized color space (for 
example, a*b* plane of a L*a*b* color space). However, when the information that that image is sent to a 
predetermined output means (for example, mini-laboratory) to have known color management profiles, 
such as an ICC profile, later is known, this information is preferably used for optimization processing. 
[0108] Here, a color profile associates the color value of the input data inputted into an output means, and 
the color value outputted by the output means (output unit). For example, when these color values as 
which the image data inputted into the output means expresses a color value as a RGB value, and is 
expressed by the output signal of an output means are Lab values, this color profile has the information 
about correspondence relation with the output Lab value expected to be an input RGB value. This Lab 
value is equivalent to the Lab value which analyzes optically the printout of the printer which is for 
example, an output means, and is measured. Reappearance of the memory color (memory color on a 
printout) outputted by the step of this optimization from an output means is optimized. 
[0109] Drawing 6 (a) is drawing showing the fundamental optimization loop by this invention, this 
invention - color correction -■ setting - data - r - g - b - inputting - having - if - color correction - 
conversion ■■ T - amending - having - a color - a value - r - ' - g -■ ' " b - ' - a value - obtaining - 
having The color space conversion of these color values is carried out, and a L*a*b* color value is 



acquired. It is checked whether the a*b* value acquired from the memory color model (color distribution) 
showing the information about a substitute color or the a*b* value of an ideal after the color space 
conversion as shown in drawing 6 (a) is in agreement with the a*b* value of an ideal. The color correction 
conversion T is changed until this coincidence becomes the optimal. This may be repeatedly performed 
like the optimization loop which drawing 7 shows. 

[0110] Conversion T* which consists of both color correction conversion T and color space conversion can 
express the color correction conversion T and a color space conversion. And conversion (it is overall) T' is 
optimized in an optimization loop. 

[0111] Drawing 6 (b) expresses optimization by forward direction modeling. The color management of a 
known output means is used together to the fundamental optimization processing of drawing 6 (a). Here, 
overall conversion T* is not a color space conversion but color management conversion. Of course, in 
another example, overall conversion T* may consist of both color management conversion and color space 
conversion. Furthermore, the sequence of color correction conversion, and a color management conversion 
or a color space conversion may be changed. For example, a color space conversion or color management 
conversion may be performed after color correction conversion. 

[0112] Color management conversion is equivalent to the actuation which applies a color profile to a r'g'b' 
color value, in order to acquire the anticipation output value from an output means. For example, when 
an output means is a printer, the L*a*b* color value expected to be outputted by color management 
conversion on a print by the printer is acquired. And whenever [ between the changed color value and the 
color value (ideal a*b*) acquired from a memory color model / coincidence ] is checked like drawing 6 (a). 
[0113] color management conversion - in addition - or - instead, it is also possible to include in the 
optimization loop which shows vanity conversion of a color to drawing 6 (a) or (b). In this case, overall 
conversion T' will consist of vanity conversion of a color further at least only not only in the color 
correction conversion T. Vanity conversion of a color expresses the vanity model of a color. When vanity 
conversion of a color replaces color management conversion in drawing 6 (b), a perceived color is 
optimized by MCPCC instead of a theoretical color (fundamental optimization) or a color (fundamental 
optimization and color management model) in the paper. 

[0114] Vanity conversion of a color is easily incorporable by replacing the color management engine of 
drawing 6 (b) with the vanity model of colors, such as CIECAM97s ("Color Appearance Modelingand 
CIECAM97s n , Tutorial Notes (CIC99), 1999, Armin Kndig) indicated by the work "the vanity model of a 
color, and CIECAM97s" of Mark Fairchild. Vanity conversion of the color showing the vanity model of a 
color is preferably doubled with the typical conditions at the time of human being perceiving a color for 
the color value outputted by color correction. 

[0115] For example, a color value may be adjusted according to the typical background color at the time of 
seeing images, such as a class (for example, A or D65) of typical lighting, and a background color of a 
photo album. Moreover, a color value may be adjusted according to the class of print media. For example, 
the class of data medium, such as existence of gloss, may affect the perception of a color. Furthermore, 
color correction may be fitted to the typical lighting reinforcement when the reinforcement (brightness) of 
lighting influencing human being's color vision, for example, seeing an image. 

[0116] It realizes by detecting at least one image pattern which usually has the memory color predicted 

that human being is [ the color correction by this invention ] visible to the image pattern. 

[0117] Drawing 7 shows roughly the structure of the photograph processor which amends according to one 



side of this invention, or the color correction equipment which operates according to this invention. The 
receiving means 100 receives image data and sends it to the selection means 200. The receiving means 
100 may be a modem or a network. The selection means 200 may be equipped with the processing section 
which chooses at least one image pattern, assigns an image pattern, and sends it to a means 300. The 
quota means 300 accesses the supply means 400, such as memory or a storage means. The supply means 
400 assigns color distribution of the memory color of the above-mentioned image pattern which 
corresponds according to a demand, or a memory color, and supplies it to a means 300. 
[0118] The quota means 300 assigns a suitable memory color or color distribution to the above-mentioned 
corresponding image pattern. The above-mentioned image pattern, the assigned memory color, or storage 
classification by color cloth is sent to the decision means 500 from the quota means 300. The decision 
means 500 opts for conversion through an above-mentioned optimization loop. The conversion for which it 
opted is sent to the conversion means 500. The conversion means 600 receives image data from the 
receiving means 100, changes image data according to the above-mentioned conversion, and obtains 
amendment image data. Amendment image data is outputted from the photograph processor or color 
correction equipment of this invention. 

[0119] It is also possible to use the statistical method for three-dimension object detection for this 
invention. The statistic about the appearance of the image pattern using the product of a histogram and 
the appearance of a "non-image pattern" may be used. Each histogram expresses the coincidence statistic 
of the subsets of a wavelet coefficient, and those locations in an image pattern. This method can detect 
human being's face certainly by the field external version using many histograms showing various vision 
attributes. 

[0120] The main technical problems of this technique are fluctuation of visual appearance. For example, 
the configuration of a face, magnitude, a hue, and the other features change with people. Visual 
appearance changes also with surrounding environment. The locations to the reinforcement, color, and 
image pattern of the light source also differ. The approaching image pattern may cast a shadow over an 
object image pattern, or may reflect an excessive light. The appearance of an image pattern is depended 
also in the location and direction over the arrangement, i.e., a camera. For example, human beings 
profile differs from the time of seeing from a transverse plane greatly. Therefore, it is adapted for all 
fluctuation of these enough, and the image pattern detection method that the target image pattern is 
distinguishable from any image pattern which may exist in visual world is needed. 

[0121] By such image pattern detection method, two steps of image pattern detection is performed. Since 
it corresponds to fluctuation of arrangement, each uses the method of the direction base using two or 
more detectors which correspond in the specific direction of an image pattern. It corresponds to other 
fluctuation by performing statisticmodeHzation in each of these detectors. 

[0122] For example, another side of one detector may be only for [ of a transverse plane ] faces only for [ of 
the right or the left ] profiles. Two or more detectors of these direction bases are used in parallel, and 
those results are unified. Two detectors of the direction base for example, the object for transverse planes, 
for right profiles, etc. are used for human being's face. What is necessary is just to use a right profile 
detector for the mirrorimage-ized input image, in order to detect a left profile. Although each detector 
may be constituted so that only the image pattern of a predetermined direction may be detected, you may 
make it detect further the image pattern which has the predetermined magnitude of square image 
window within the limits. 



[0123] Therefore, repeat application of the detector is carried out in all the locations that a square window 
can take so that it can detect, wherever the image pattern or the face may be located in [ of an image ]. 
And repeat application of the detector is carried out at the image which repeated and changed the 
magnitude of an input image so that it might not be concerned with the magnitude of an image pattern 
but detection might be possible, and changed magnitude. 

[0124] The fundamental form of the statistical-decision rule used for each detector is the same. These 
detectors are different only in the point which is using the statistic collected from a mutually different 
image group. 

[0125] Two statistical distribution models can be created to the detector of the direction base, respectively. 
These are the models of the statistic P (image I non-object) of visual world other than an image pattern 
called the model of the statistic P of a predetermined image pattern (image I object), and "non-image 
patterns." And a detection result comes out by the likelihood ratio test. 
[0126] 

[Equation 3] 



[0127] When a likelihood ratio (left part) is larger than the right-hand side, it is judged that an image 
pattern exists. 

[0128] If this likelihood ratio test is equivalent to the decision rule (MAP decision rule) of Bayes and its 
expression of P (image I object) and P (image I non-object) is exact, it will become the optimal. The form 
of the function used for these models below is explained to details. 

[0129] In each formula, an image pattern and a non-image pattern are expressed with a term called an 
object (object) or a non-object (non-object), respectively. 

[0130] Since model creation of P (image I object) and P (image I non-object) has the strange statistical 
feature about the vanity in an image pattern or the other world, it is difficult, for example, actual 
distribution is gauss (Gaussian) distribution and is poisson (Poisson) distribution - or it is strange 
whether they are many mode distribution. The thing with these strange features is because it is difficult 
to analyze simultaneous distribution about many pixels. 

[0131] It is important to choose the flexible model which is adapted for all structures here. Although a 
histogram is adaptable on almost a par with the method of the memory base, the compacter expression 
which searches for probability by the table search is used. What is necessary is just to measure the 
frequency where each attribute value appears in training data simply, for presumption of a histogram. 
Obtained presumption is statistically the optimal, does not have a bias, and was not contradictory, and 
satisfies the lower bound of Cramer-Rao. 

[0132] The main defects of a histogram have the measurement value which can be used since the 
appearance of an image is expressed in few [ comparatively ] things. Many histograms are used in order 
to solve this limit. It is each histogram Pk (image I object) here. The probability of the appearance 
belonging to a certain predetermined vision attribute patternk is expressed. In addition, patternk is a 
random variable showing the selected visual feature it is [ component / low frequency ] characteristic. 
Although it is necessary to divide appearance into two or more vision attributes, it is necessary to unify 
the probability of two or more different attributes in that case. 



[0133] In order to unify the probability of two or more different attributes, it is necessary to ask for the 
following products, here - a kind - conditional - each is approximated for a stochastic function as a 
product of a histogram. 
[0134] 

[Equation 4] 



[0135] 

[Equation 5] 



[0136] In case the expression of P (image I object) and P (image I non-object) is constituted, an attribute 
(patternk) assumes absolutely that it has been independent statistically about either an image pattern or 
an object and a non-image pattern or a non-object. 

[0137] In order to decompose visual appearance into a different attribute, it is necessary to determine 
with which measured value create an integrated model with which measured value of an image, and an 
independent model is created. If it seems that an object or an image pattern can be discriminated from 
the other world with the integrated relation of two variables, it is desirable to create an integrated model. 
When an effect is unknown, probably the twist which does not create a model at all is good to make those 
variables become independent and to create a model. 

[0138] It is necessary to create the integrated model of the visual information which carries out 
localization in space, frequency, and the direction about a face and other image patterns. Therefore, it is 
necessary to decompose visual appearance to these dimensions. An object or each vision attribute of the 
appearance of a pattern space needs to decompose appearance so that the field on the object localized 
spatially may be expressed. Thereby, the modeling capacity for each histogram to have been restricted 
concentrates on more nearly little visual information. 

[0139] Two or more attributes from which a scale differs [ the important hand of detecting a face and a 
vehicle ] since there is various magnitude in a loan are needed. Such an attribute is specified by 
decomposing into coincidence in both space and frequency. Since low frequency occupies a large field and 
high frequency occupies a narrow field, it is defined as the attribute of a large space range expressing low 
frequency, and the attribute of a narrow space range is defined as expressing high frequency. 
[0140] The attribute for a narrow space range is high resolving, and can catch the characteristic field 
where faces, such as an eye, a nose, and opening, are narrow. A hand with others important for the 
attribute defined by low resolution as a larger field can catch a loan. For example, if it says by the face, 
hands, such as **** brighter than an eye socket, will be loans. 

[0141] Furthermore, there is also an attribute decomposed according to a direction. For example, if the 
attribute specialized by the level feature is used, compared with the case where it expresses also about 
the perpendicular feature, the expression capacity over the level feature will become larger. 
[0142] Now, not all of the relation of decomposition portions are disregarded just because it disassembles 
an object or an image pattern spatially. A hand with detection important for the spatial relations of 



decomposition portions serves as a loan. For example, by human being's face, attribute samples, such as 
an eye, a nose, and opening, have the regular geometry. In order to model these geometric features, it is 
necessary to express the location of each attribute sample to the coordinate frame fixed to the object. 
[0143] In addition to this, the location to all samples of each sample can be known with this expression. 
By this expression, the histogram of each model is an attribute and the simultaneous distribution Pk 
(patternk (x y), x, y I object) of an attribute location. And Pk (patternk (x y), x, y I non-object) It becomes. 
The attribute location x and y are measured for every square image window. However, an attribute 
location can also be expressed in not initial resolution but the coarser resolution of an image so that the 
cost of modeling can be absolutely responded to lowering and small fluctuation of the geometry of a 
decomposition portion. 

[0144] In order to create the vision attribute localized in space, frequency, and the direction, it is 
necessary to enable it to choose easily the information localized into these dimensions. Therefore, it is 
desirable to change an image into the expression localized in space, frequency, and the direction at 
coincidence. Therefore, it is desirable to perform wavelet transform of an image. 

[0145] Space, frequency, and a thing usable to the decomposition to a direction are not only wavelet 
transforms. Such an expression can be created also with the short-term Fourier transform or a pyramid 
algorithm. However, since the number of transform coefficients is in agreement with the number of initial 
pixels of an image by wavelet transform compared with these conversion and an image can be completely 
reconfigurated by conversion, there is no redundancy. 

[0146] Wavelet transform is composed in the subband which localizes an image in a direction and 
frequency. Within the limits of each subband, the coefficient has localized spatially, respectively. In 
wavelet transform, as shown in drawing 8 , ten subbands are created by 3 hierarchical decomposition 
which used 5 / 3 linear-phase filter bank, so that it may be indicated by "the wavelet and the filter bank" 
(Wavelet and Filter Banks, WeDesley-Cambridge Press, 1997) of G.Strang and a T.Nguyen work. 
[0147] In conversion, a hierarchy high [ one ] expresses high frequency one octave. A hierarchy's 1 
coefficient expresses 4 times of the field a hierarchy's 2 coefficient, and a hierarchy's 2 coefficient 
expresses 4 times of the field a hierarchy's 3 coefficient. LH shows horizontal low-pass filter processing 
and vertical high-pass-filter processing, i.e., the level feature. Similarly, HL shows the perpendicular 
feature. 

[0148] A vision attribute is specified based on this expression. It is defined as each attribute sampling the 
migration window of a transform coefficient. For example, a certain attribute may be defined as 
expressing 3x3 window of the coefficient a hierarchy's 3 LH band. This attribute expresses the level 
pattern of the high frequency which occupies the small range of a subject-copy image. Another pattern 
group may express 2 x2 block registered spatially in the 2nd a hierarchy's LH and HL band. This 
expresses the intermediate frequency band which occupies the larger space range of an image. 
[0149] Accepting only the value of a finite number, or since each attribute is made, it needs to calculate 
vector quantization of the sampled wavelet coefficient. Since it combines to x and y (location) and about 
100 enumerated data are acquired in order to make the number of the bottles of a histogram into less 
than 1 million pieces, it is necessary to express each attribute using 10,000 or less enumerated data. For 
that purpose, each vision attribute is defined as sampling the wavelet coefficient of eight pieces at a time, 
and quantizes each coefficient to three hierarchies. 38 = 6,561 enumerated data are acquired about each 
vision attribute by this quantization. 



[0150] The attribute of 17 pieces which samples wavelet transform by any following one method on the 
whole to two or more groups who consist of the coefficient of eight pieces is used, for example. 
[0151] A: All coefficients belong to the same subband in a subband. The vision attributes most localized in 
frequency and a direction are these. Such an attribute is defined by seven subbands (that is, hierarchy 
ILL, hierarchy 1LH, hierarchy 1HL, hierarchy 2LH, hierarchy 2HL, hierarchy 3LH, hierarchy 3HL). 
[0152] B: Although it belongs in the same direction between frequency, it is a coefficient belonging to two 
or more frequency bands. The visual hand that these attributes stretch two or more frequency, such as an 
edge, expresses a loan. Such an attribute is defined using six and a subband pair (namely, hierarchy 
lLLhierarchy 1HL, hierarchy lLLhierarchy 1LH, hierarchy lLHhierarchy 2LH, hierarchy 
lHL hierarchy 2HL, hierarchy 2LHhierarchy 3LH, hierarchy 2HL hierarchy 3HL). 

[0153] C: Although it belongs to the same frequency band between directions, belong to two or more 
direction bands. The hand that these attributes have a horizontal component and vertical components, 
such as a corner, expresses a loan. Such three attributes are determined using a subband pair (namely, 
hierarchy lLHhierarchy 1HL, hierarchy 2LH hierarchy 2HL, hierarchy 3LHhierarchy 3HL). 
[0154] D: The hand of stretching the frequency and the direction of plurality [ combination / this ] 
expresses a loan between frequency / between direction. Such an attribute that unifies two or more 
coefficients is defined by the subband of hierarchy ILL, hierarchy 1LH, hierarchy 1HL, hierarchy 2LH, 
and hierarchy 2HL. 

[0155] The attribute which uses a hierarchy's 1 coefficient expresses the large space range corresponding 
to a narrow low frequency range with space -frequency decomposition. The attribute using a hierarchy's 2 
coefficient expresses the space range of the medium size corresponding to a middle frequency range, and 
the attribute using the coefficient of **** 3 expresses the narrow space range corresponding to a large 
high-frequency range. 

[0156] And it migrates to all the ranges of an object, and each attribute is sampled at a fixed gap so that 
samples may overlap partially. This is performed so that the maximum information can be used for the 
decision of detection. For example, although the feature with remarkable eye, nose, etc. is very important 
for face detection, the field of others, such as a cheek and a jaw, is also helpful even if it is not comparable 
to the former. 

[0157] Therefore, the final form of a detector is defined by the degree type. 
[0158] 

[Equation 6] 



[0159] By the formula (10), "region" shows the image window classified. 

[0160] Next, they are Pk (patternk (x y), x, y I object) and Pk (patternk (x y), x, y I non-object). It is 
necessary to develop an actual histogram. In case statistics are collected, selection of the example of study 
of the kind of "a non-object" (non -object) or a non-image pattern poses a problem first. This kind expresses 
notionally the visual appearance of all the things in which it exists other than an object really. In order to 
classify correctly, it is important that a possibility of being mistaken for an object uses the non-object 



sample which seems to be the highest. 

[0161] This concept resembles the support vector machine which chooses the sample near a decision 
boundary so that it may be indicated by the "statistical learning theory" (The Nature of Statistical Theory 
Springer, 1995) of a V.N.Vapnik work. Thus, the method of bootstrapping is applicable to the selected 
sample. Two or more samples chosen from the non-object image group at random in bootstrapping are 
used, and it is Pk (patternk (x y), x, y I non-object). A reserve detector can be made to learn by presuming. 
And about 2000 image groups which do not include an object are measured using this reserve detector, 
and a response chooses the high field further as a sample. 

[0162] Statistic Pk (patternk (x y), x, y I object) It collects from the image of an object. 2000 subject-copy 
images are used about each of a view which looks at a face. Furthermore, to each subject-copy image, a 
minor change is added to modification of a background scene, an aspect ratio and a direction, frequency, 
and a location, and about 400 deformation images are compounded. 

[0163] The statistic used for these examples of study is collectable with two or more technique. In the face 
detector of this example The paper of Y.Freund and R.E.Shapire "decision theory generalization of online 
study, and application to boosting" 0 [ "A Decision-TheoreticGeneralization of On-Line ] Learning and an 
Application to Boosting", Journal of Computer and System Sciences, 55:1, p. 119-139, and 1997, R. Paper 
of E.Shapire and Y.Singer "amelioration of the boosting algorithm using the prediction by which reliance 
ranking was carried out" 0 [ "Improving Boosting Algorithms Using Confidence-rated ] The category error 
of a study group is made into min using Predictions", and Machine Learning 37:3, p.297, 336, December 
and the AdaBoost algorithm indicated by 1999. 

[0164] An AdaBoost algorithm is accompanied by repetitive operation. A detector assigns and learns the 
same weight as all the examples of study first. Next, a detector is relearned repeatedly. When [ each ] it 
learns last time [ repeatedly ], weight is attached to the example of study classified accidentally. The 
category error decreases according to this process. 

[0165] This technique is a heuristic approach from a rough phase to an energy phase. Each likelihood 
ratio of the location of the object which is possible first is partially calculated using the vision attribute of 
low resolving, i.e., the attribute using a hierarchy's 1 coefficient, then - the image pattern candidate 
exceeding the minimum threshold of the above-mentioned partial evaluation promising that is, - more ■ 
high - evaluation [ **** ] is performed. 

[0166] The conversion for amending a color value is preferably applied to a color value in adjustable 
depending on at least one image property. Amendment is eclipse ****** with weight locally preferably. A 
mask can be used for weighting. The element of a mask corresponds to the partial portion of an image, for 
example, 1 pixel, and two or more contiguity pixels, and these elements express preferably the image 
property (for example, lightness) of a partial portion. Weighting is performed to at least one image 
property. This image property is brightness (lightness) preferably. Image properties may be contrast 
(part), a hue, a color saturation ratio, the Colorcon trust, sharpness, etc. at instead of or a pan. Especially 
the artificer found out preventing the color cast produced to a bright field by weighting depending on 
brightness. 

[0167] weighting is desirable and amendment is performed in middle or the field of average brightness 
rather than the field of low or high brightness (the degree of amendment becomes higher) - it performs 
like. When an above-mentioned weighting factor takes the value between 0-1, a weighting factor is close 
to zero or zero in low brightness. As for a weighting factor, it is desirable to fall, if it becomes large and 



applies to high brightness from middle as middle brightness is approached. In the highest or highest 
possible brightness, a correction factor is abbreviation zero or zero preferably. As a function used in order 
to calculate a weighting factor based on brightness, you may be the reverse **** function which has 
maximum around middle brightness. 



[Translation done.] 



* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s hows the word which can not be translated. 
3.1n the drawings, any words are not translated. 
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[Brief Description of the Drawings] 

[Drawing ll It is a flow chart explaining the energy detection phase of the face detection by this invention. 
[Drawing 2l It is drawing showing an example of the pictogram of the face discriminated from a digital 
image. 

[Drawing 3l It is drawing showing another example of the pictogram of the face discriminated from a 
digital image. 

[Drawing 41 It is drawing showing "neutral colors" (continuous line), a "blue sky" (dashed line), "body 
warmth" (dotted line), and the memory color model of "foliage" (one-point dashed line). 
[Drawing 51 It is drawing showing the prior information distribution p (log (rf), log (gf)) of a specific model 
(a Kodak DC 210 zoom digital camera, lower part) with a common digital camera (upper part). 
[Drawing 61 (a) is drawing explaining optimization through forward direction modeling by the 
fundamental example of this invention, (b) is drawing explaining optimization through forward direction 
modeling which applied the color management for known output means to the above-mentioned 
fundamental example. 

[Drawing 7l It is drawing showing roughly the structure of the photograph processor equivalent to the 
color correction equipment by another example of this invention. 

[Drawing 81 It is drawing showing the image expression by the wavelet transform of 3 hierarchies and 10 

subband division. 

[Description of Notations] 

100 Receiving Means 

200 Selection Means 

300 Quota Means 

400 Supply Means 

500 Decision Means 

600 Conversion Means 
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